Skip to content

SDI References volumes 1 & 2

Search Changes About

All chapters Chapter 9

Design A Web Crawler

14 references

Filter these references /

Reference 1 in Chapter 9: US Library of Congress

loc.gov
Reference 2 in Chapter 9: EU Web Archive

data.europa.eu
Reference 3 in Chapter 9: Digimarc

digimarc.com
Reference 4 in Chapter 9: Mercator: A scalable, extensible web crawler

courses.cs.washington.edu PDF
Reference 5 in Chapter 9: Web Crawling

infolab.stanford.edu PDF
Reference 6 in Chapter 9: 29% Of Sites Face Duplicate Content Issues

tinyurl.com
Reference 7 in Chapter 9: Fingerprinting by Random Polynomials

1981
Reference 8 in Chapter 9: Space/Time Trade-offs in Hash Coding with Allowable Errors

1970
Reference 9 in Chapter 9: Donald J. Patterson, Web Crawling

ics.uci.edu PDF
Reference 10 in Chapter 9: The PageRank Citation Ranking: Bringing Order to the Web

1998
Reference 11 in Chapter 9: Space/Time Trade-offs in Hash Coding with Allowable Errors

1970
Reference 12 in Chapter 9: Google Dynamic Rendering

developers.google.com
Reference 13 in Chapter 9: Tracking Web Spam with Hidden Style Similarity

2006
Reference 14 in Chapter 9: IRLbot: Scaling to 6 billion pages and beyond

irl.cs.tamu.edu PDF

No references match.

Try a different word, or search every chapter.

PreviousDesign A Url Shortener NextDesign A Notification System

The reference lists are by Alex Xu and Sahn Lam, from System Design Interview: An Insider’s Guide, and are published at github.com/alex-xu-system/bytebytego. This site is not affiliated with them or with ByteByteGo.

Made by Laith Shadeed. Links last checked Aug 30, 2026. Chapters · Search · Changes · About.