Large Scale Web Search Engine Design Basics And Challenges

Tuoshi Lu, Yahoo!, Sunnyvale

Stevenson Hall 1300
11:00 AM - 11:50 AM

Search engine technologies have been around for a long time. It's not too hard to build an engine for an enterprise. Databases can also function as search engines. However, to build a search engine at web scale that can support millions of users and search through billions of web pages with sub-second performance is a huge challenge. This challenge is compounded by an open Internet with unstructured information and a very diversified user community. This talk examines the technologies behind modern search engines and the issues search engine designers face.