What is the essential reading on search engine development?

I have found help in these:

Books:
Modern Information Retrieval
Ricardo Baeza-Yates, Berthier Ribeiro-Neto
http://www.sims.berkeley.edu/~hearst/irbook/

Managing Gigabytes
Ian Witten, Ian H. Witten, Allistair Moffat, Timothy C. Bell
http://www.cs.mu.oz.au/mg/

Webbooks:
INFORMATION RETRIEVAL
C. J. van RIJSBERGEN
http://www.dcs.gla.ac.uk/Keith/Preface.html

Articles:
The Anatomy of a Large-Scale Hypertextual Web Search Engine
Larry Page, Sergei Brin
http://citeseer.ist.psu.edu/brin98anatomy.html

Building a Distributed Full-Text Index for the Web
Sergey Melnik, Sriram Raghavan, Beverly Yang, Hector Garcia-Molina
http://citeseer.ist.psu.edu/478324.html

The PageRank Citation Ranking: Bringing Order to the Web
Larry Page,Sergey Brin, R. Motwani, T. Winograd
http://citeseer.ist.psu.edu/page98pagerank.html

Search Engines and Web Dynamics
Knut Magne Risvik, Rolf Michelsen
http://citeseer.ist.psu.edu/risvik02search.html

Focused Crawling Using Context Graphs
M. Diligenti, F.M. Coetzee, S. Lawrence, C.L. Giles, M. Gori
http://citeseer.ist.psu.edu/diligenti00focused.html

Authoritative Sources in a Hyperlinked Environment
Jon M Kleinberg
http://citeseer.ist.psu.edu/kleinberg99authoritative.html

Great post, thanks. Here are some additions:

Books:
Mining the Web
Soumen Chakrabarti
http://www.cs.berkeley.edu/~soumen/mining-the-web/
This book especially covers some basic concepts in Web IR. It’s not a book about the handling of big amounts of data, but how to exploit the link structure of the web for building a good search engine.

Articles:
Searching the Web
Arasu, Arvind; Cho, Junghoo; Garcia-Molina, Hector; Paepcke, Andreas; Raghavan, Sriram
http://dbpubs.stanford.edu:8090/pub/2000-37
This article offers a very comprehensive overview of current Web search engine design. IMHO a must-read.

Efficient Crawling Through URL Ordering
Cho, J.; Garcia-Molina, H.; Page, L.
http://dbpubs.stanford.edu:8090/pub/1998-51
Shows methods on how to retrieve the “best” pages first.

Inferring Web Communities from Link Topology
David Gibson, Jon Kleinberg, Prabhakar Raghavan
http://citeseer.ist.psu.edu/gibson98inferring.html
Explains how the link structure of the web can be used to find web communities and hence authority pages.

one more:

Books:
Web Document Analysis
Apostolos Antonacopoulos, Jianying Hu [Eds.]
http://www.worldscientific.com/books/compsci/5375.html
This book contains of several papers about various aspects of document analysis, including web image processing, content extraction, CAPTCHAs aso.

Lucene in Action
Erik Hatcher and Otis Gospodnetić
http://www.manning.com/books/hatcher2

Apache Lucene is a open source, high-performance, full-featured text search engine library written entirely in Java. It is a technology suitable for nearly any application that requires full-text search, especially cross-platform.

Lucene in Action is the authoritative guide to it. It covers analysis, indexing, searching and querying, as well as crawling the web, and handling different files, like HTML, Word, PDF and XML.

Reviews:
http://www.oscom.org/events/oscom4/proposals/lucene
http://www.amazon.com/exec/obidos/tg/detail/-/1932394281?v=glance

Practical Issues of Crawling Large Web Collections
Carlos Castillo and Ricardo Baeza-Yates

During large crawls of the Web, we have observed several anomalies in the implementation of the basic protocols by some Web sites. These anomalies impose costs on the design of a Web crawler and reduce the findability of information on the Web.

We document several issues related to networking, DNS, HTTP, HTML and application programming. Our aim is to help Web crawler designers and Web application developers to improve the interoperability of their Web systems.

http://www.dcc.uchile.cl/~ccastill/papers/castillo_05_practical_web_crawling.pdf

Life after having a Chapter 7 bankruptcy just isn’t as daunting as much would maybe you have think. In reality, most with the negative information on the market is spewed from the creditors that get left behind when you file for bankruptcy protection. skincarepearls.net

Honesty and also integrity are necessary to the particular building regarding society. These kinds of cornerstones develop prosperity and also peaceful sociable order. Dishonesty and also greed are usually destructive makes that split society straight down. fashionismydrug.org

Mongolia features a significant verified area regarding coal mining sector. Inside Mongolia the particular annual coal production will be approximate concerning 5 thousand metric plenty. Almost 85% with this production is employed for heavy steam and electrical energy generation. healthbeautycare.net

Throughout the last decade Taupo inside New Zealand provides continued to be able to attract fresh house building contractors and demonstrate that its not all small villages are regressing. Read this informative article and discover three logic behind why Taupo is growing both inside population dimensions and cheaply. mensmeds.net

There are usually some basic steps you can easily follow to create a productive lawn attention business. Once you know these methods, it is very important to continually remind yourself of which or many times yourself screwing up and slowly and gradually lose consumers. interior2han.net

Home well being service nowadays offers a great deal to patients that are recuperating coming from surgery or perhaps illness. These companies offered enable patients to recoup comfortably inside their own residence, without straining families which can’t provide a lot of services. fatburningfurnacereport.org

In this post I describe research My partner and i conducted so that you can understand exactly why people believe balanced diet is a lot more expensive as compared to unhealthy foods. I examine the info I performed and form an impression good results coming from my trial. insurancehealthquote.org

Narrowly identified, “moderate alcohol consumption consumption” decreases health chance from heart problems. But that raises chance for different cancers, hepatitis, weak bones, immune suppression, accidents, and also suicide. They don’t really tell an individual that portion. intuitionandhealing.org

The second half getting unwell is fussing with all the health insurance policy claims method. I involve some tips to be able to pass-on from my own, personal health promises experiences which may help an individual navigate this kind of maze. dailyhealthtrends.net

Changes inside the health attention environment are usually here. Since physician management, are you willing to build robust, flexible medical care teams that may thrive? Three techniques are presented in this post that can position you along with your team to ensure success. salesmanagementsystems.net

Many property owners are eliminating high wants grass from other yards and deciding on a entertaining garden as an alternative. If you are not ready to quit on the green floor covering, here are usually some methods for a a wholesome green, marijuana free garden. cheapclothesshoppingonline.net

Education regarding Sustainable Advancement (ESD) can be a rather fresh field regarding education. We could see it as a possible innovative sort of future schooling for universities linking the particular child’s development with all the future difficulties of community. ehealthplanners.net

There certainly are a small band of young Americans that are already using education offshore. They acquire credits in the direction of their college degree at any cheaper value, get to have the living overseas and also travel about Asia. heavenhomes.org

Understand here exactly why large organizations, small kinds and professionals each is using cloud enterprise computing for many different reasons. The fog up system will be described and also predictions are manufactured for the future enlargement. gloucesterplumbing.net

Law just isn’t the start place, nor can it be the finishing place in terms of ethics. Our meaning ideas usually shape the type of our own laws. Criticism regarding laws and also proposals regarding change inside our laws tend to be based over a shared meaning ideal that’s not being attained. weightlossshakeshq.org

This article is obviously directed with men yet ladies in order to comment next feel totally free! Understand just what it is usually to be a person! I’m not discussing what an individual learned from the dad or friends and family, what After all is the method that you as a person project yourself to others. prolawteam.net

A year ago the BRITISH winter created a huge freeze, this is unusual, as many winters in britain are provided by slight westerly winds from your Atlantic marine, but winter months of 2009/2010 was being much distinctive from normal. clubsimenahotel.net

Fashion features a rippling influence on people coming from different taking walks of living. It steadily gains reputation among diverse strata regarding society. To aid fashion contact the buyers, a large numbers of professionals are expected. certifiedhealthcoach.net

Shopping regarding camping chairs might appear simple adequate, but knowing the most effective places to check will allow you to find usually the one you need while saving you both moment and funds. Hint: don’t commence your search on the supermarket! marketyourpractice.net

Food shopping over a budget? Once you enter virtually any supermarket, you may fall sufferer to marketing and advertising. Marketing is just the properly researched research of what makes people acquire. Don’t belong to the marketing and advertising trap. Here are usually 14 intelligent tips to assist you save 10 : 15% of one’s money any time food purchasing… beautyandstyling.net

The Pappa Rocking Seashore Chair is the location where the beach satisfies the deck! So if the buying a beach couch that boulders likes any porch chair which is light, easily transportable and folds up flat, then this kind of beach chair could be the one to suit your needs! safeguardfinancialusa.com

If you might be like myself and really like designer garments at lower price prices then you’ll find this write-up useful. It is packed with tips on where you should shop in New york and getting Designer brands at good deal prices, along with on getting around town. firstcallservices.org

Shopping regarding gifts hasn’t been less difficult. This is very true in the event you go online to search for the gifts. Thousands of merchants are available really gorgeous, quality items at affordable prices and you may shop from your comfort of one’s living area and notebook! veghealth.net

Everyone will be buzzing about becoming enviromentally friendly these days as well as the home is probably the best places to start out. Since we all spend a great deal time in your homes, it just is practical to commence being a lot more eco-friendly right now there. Here, we’ll examine five ways your household can start becoming enviromentally friendly with a great eco residence. seniorsinsuranceadvice.net

So what exactly is it want to own section of a home in the corner with the largest wine-producing location in Italy? Imagine a few of your very best wines and also similar descriptions receive play: historical past, depth, difficulty, uniqueness regarding character. How sweet it really is. shopfisher.net

If you’re to obtain a property around the beachfront, wouldn’t you decide on the spot that combines an evergrowing role around the international landscape with available prices? In the event you said sure, consider a property or residence in Cancun. lyfood.net

Given that we’ve included IT components, computer safety and devastation recovery (you should see elements 1 & 2 with this series), let’s go through the vast selection of other odds and ends you need to make items happen swiftly and efficiently at home business. betaeducation.net

Luxury real-estate in Victoria, BC, is truly a number of the very best in the world. Macleans newspaper selected Victoria as the top city inside Canada where to relocate a family group business. Conde Nast Traveller magazine voted Victoria the most effective over-all metropolis in Canada for the environment and also ambiance. childrensoralhealthohio.net

Dramatic changes have taken place inside the market in Marbella. In reality over the full Costa del Sol. Property here is definitely in requirement by Upper Europeans because the climate is quite warm and also sunny a lot of the year and the expense of living continues to be historically lower. myattorneyatlaw.net

Buyers and also sellers, please make sure you entrust this kind of transaction with a full time real-estate professional together with experience plus a track document. Someone that is able to give an individual expert advice on homes inside Summit NJ-NEW JERSEY or the market location. buddha-yoga.net

During days gone by week, the planet has witnessed some events in which influenced the many sectors with the growing international economy. On one hand, some activities promised a lot more developments and also expansion not merely in the particular international trade but in addition in certain countries. ansaricapital.com