Get the latest tech news
The Anatomy of a Large-Scale Hypertextual Web Search Engine (1998)
Brin and Lawrence Page {sergey, page}@cs.stanford.edu Computer Science Department, Stanford University, Stanford, CA 94305 Abstract In this paper, we present Google, a prototype of a large-scale search engine which makes heavy use of the structure present in hypertext. Google is designed to crawl and index the Web efficiently and produce much more satisfying search results than existing systems.
This design decision was driven by the desire to have a reasonably compact data structure, and the ability to fetch a record in one disk seek during a search Additionally, there is a file which is used to convert URLs into docIDs. This scheme requires slightly more storage because of duplicated docIDs but the difference is very small for a reasonable number of buckets and saves considerable time and coding complexity in the final indexing phase done by the sorter. Some of his research interests include the link structure of the web, human computer interaction, search engines, scalability of information access interfaces, and personal data mining.
Or read this on Hacker News
