I run www.boitho.com, it is pland to be a algorithmic, crawler based search engines based on it’s own file structures (not a sql database), writen in Perl and C.
It is still in development, sow please don’t judge me based on the search engine that you find at www.boitho.com. That is a 1.5 years old demo we made to show to potential investors how thumbnail pictures can be used in search engines.
I are curently studying Information Retrieval at Norwegian University of Science and Technology. Where I attend lecturs by peoples like Knut Magne Risvik, former Director of Engineering at FAST Search & Transfer (the company behind AllTheWeb), now Chief Architect for search at Yahoo, Dr. Jon Atle Gulla, managing director for development of linguistic software at FAST , and others from FAST.