Does anyone know which open source fulltext database would be be best to use?

http://www.seg.rmit.edu.au/zettair/
http://swish-e.org/
http://lucene.apache.org/java/docs/
http://www.xapian.org/

Or any others? I understand nutch uses lucene right?

Yes, Nutch is built on Lucene. But I am not sure if Nutch uses Lucene directly, or its one modified version.

How many documents are you planning to index?

If you are to only index some million document you should look into Berkeley DB.

If you are planning to index the web Swish-e statement on the front page: “Swish-e is ideally suited for collections of a million documents or smaller” is not a god sign.

Lucene is the only open source indexing system I know about that have been used successfully to index large portions of the web. It is used by many, and well documented. It is even written a book on how to use it to create a search engine with (Lucene in Action, http://www.amazon.com/gp/product/1932394281/002-9859404-2104047?v=glance&n=283155))

But Lucene is written in Java, and Java isn’t especially fast. Traditionally search engines is written in C/C++

Have anyone look at Mifluz ( http://gnu.mirrormonster.com/software/mifluz/doc.en.html )? It is a GNU project to make a library to store a full text inverted index. Written in C++

What I have heard of, Nutch is using Lucene in its regular form, what Nutch does is adding a spider and so on.

And, I have a small project thats coming up, Im only going to index about 1-2 million documents. What fulltext db do you guys suggest for that?

By the way, have anyone here actully tried Lucene or Mifluz?

Thanks

Lucene is written in Java, but has been ported to other languages - do a google on clucene for the C++ version, for example.

What I have heard of, Nutch is using Lucene in its regular form, what Nutch does is adding a spider and so on.

And, I have a small project thats coming up, Im only going to index about 1-2 million documents. What fulltext db do you guys suggest for that?

By the way, have anyone here actully tried Lucene or Mifluz?

Thanks

I think this is true, but nutch seems to have fully integrated lucene into its package structure, rather than having it exist as a separate “lucene” package. The nutch website seems a bit vague as the version relationship between nutch and lucene.

Simon
Masidani

See this link for an interesting comparison of various off-the-shelf search engine indexing components: http://www.cs.yorku.ca/~cs211299/pdf/Read6_u.pisa-attardi.tera.pdf .

It appears to suggest that zettair is better than lucene in terms of performance.

Simon
Masidani

Seems that that page cannot be found.

But the dokuments is her also:
http://www.cs.yorku.ca/~mladen/pdf/Read6_u.pisa-attardi.tera.pdf

bdw, nice find

Indexing times were 13 min. for IXE, 6 min. for Zettair and 4 hours for
Lucene

Is the bad Lucene performance because is’t writend in Java? Is Java realy that slow?

But the dokuments is her also:
http://www.cs.yorku.ca/~mladen/pdf/Read6_u…ttardi.tera.pdf

I got a NOT FOUND to this link as well.

try http://trec.nist.gov/pubs/trec13/papers/upisa-tera.pdf

Just one thing to note about the Nutch-Lucene relationship - although Nutch uses Lucene, the relationship is not always kept in tandem with the latest release of Lucene. This is, I suspect, because there’s some tailoring of Lucene in the Nutch version - i.e, it’s not a straightforward drop of Lucene into Nutch.

Simon

Life after having a Chapter 7 bankruptcy isn’t as daunting as numerous would perhaps you have think. Actually, most from the negative information available is spewed through the credit card providers that miss out when you seek bankruptcy relief protection. skincarepearls

Honesty as well as integrity are important to the actual building associated with society. These types of cornerstones construct prosperity as well as peaceful interpersonal order. Dishonesty as well as greed tend to be destructive causes that disparaging offer society lower. fashionismydrug

Mongolia includes a significant confirmed area with regard to coal exploration sector. Within Mongolia the actual annual fossil fuel production is actually approximate regarding 5 zillion metric lots. Almost 85% of the production can be used for water vapor and electrical power generation. healthbeautycare

Throughout the last decade Taupo within New Zealand offers continued in order to attract brand new house building contractors and show that not every small cities are suffering. Read this short article and discover three explanations why Taupo keeps growing both within population dimension and fiscally. mensmeds

There tend to be some stages you may follow to construct a prosperous lawn treatment business. Knowing these actions, it is essential to continuously remind yourself of these or you might find yourself screwing up and gradually lose clients. interior2han

Home wellness service these days offers a lot to patients who’re recuperating through surgery or even illness. These providers offered permit patients to recuperate comfortably within their own house, without troubled families that can’t provide a lot of those services. fatburningfurnacereport

In the following paragraphs I clarify research We conducted to be able to understand the reason why people believe appropriate food choices is now more expensive compared to unhealthy meals. I examine the information I carried out and form a feeling in line with the results through my test. insurancehealthquote

Narrowly described, “moderate alcoholic beverages consumption” decreases health danger from heart disease. But this raises danger for numerous cancers, hepatitis, weakening of bones, immune reductions, accidents, as well as suicide. They do not tell a person that component. intuitionandhealing

The second 1 / 2 of getting ill is fussing using the health insurance coverage claims procedure. I possess some tips in order to pass-on from my very own health statements experiences that may help a person navigate this particular maze. dailyhealthtrends

Changes within the health treatment environment tend to be here. Because physician frontrunners, are you prepared to build powerful, flexible healthcare teams which will thrive? Three methods are presented in the following paragraphs that may position you as well as your team achievement. salesmanagementsystems

Many home owners are getting rid of high requirements grass using their yards and choosing a enjoyable garden rather. If you just aren’t ready to stop on your own green carpeting, here tend to be some strategies for a a proper green, pot free yard. cheapclothesshoppingonline

Education with regard to Sustainable Improvement (ESD) is really a rather brand new field associated with education. We are able to see it being an innovative type of future training for colleges linking the actual child’s development using the future problems of culture. ehealthplanners

There really are a small number of young Americans who’re already benefiting from education abroad. They obtain credits towards their degree at the cheaper cost, get to see the existence overseas as well as travel close to Asia. heavenhomes

Discover here the reason why large companies, small types and professionals each one is benefiting from cloud company computing for a number of reasons. The foriegn system is actually described as well as predictions are created for it’s future growth. gloucesterplumbing

Law isn’t the starting place, nor could it be the closing place with regards to ethics. Our meaningful ideas frequently shape the type of the laws. Criticism associated with laws as well as proposals with regard to change within our laws in many cases are based on the shared meaningful ideal which is not being accomplished. weightlossshakeshq

This article is actually directed from men however ladies if you wish to comment after that feel free of charge! Understand exactly what it will be a guy! I’m not referring to what a person learned out of your dad or your pals, what After all is the way you as a guy project you to ultimately others. prolawteam

This past year the UNITED KINGDOM winter created a large freeze, i thought this was unusual, as the majority of winters in the united kingdom are provided by moderate westerly winds in the Atlantic marine, but the cold winter months of 2009/2010 was to become much distinctive from normal. clubsimenahotel

Fashion includes a rippling relation to people through different strolls of existence. It progressively gains recognition among various strata associated with society. To assist fashion find the customers, a many professionals are expected. certifiedhealthcoach

Shopping with regard to camping chairs might seem simple sufficient, but knowing the very best places to appear can help you find the main one you would like while helping you save both period and cash. Hint: don’t begin your search in the supermarket! marketyourpractice

Food shopping on the budget? Whenever you enter any kind of supermarket, you’ll fall target to advertising. Marketing is merely the nicely researched technology of why is people purchase. Don’t fall under the advertising trap. Here tend to be 14 wise tips that will help you save 10 : 15% of the money whenever food buying… beautyandstyling

The Pappa Rocking Seaside Chair is in which the beach fulfills the outdoor patio! So in case your searching for a beach seat that rubble likes the porch chair and it is light, transportable and folds over flat, then this particular beach chair may be the one for you personally! safeguardfinancialusa

If you’re like me personally and adore designer clothing at low cost prices then you will discover this post useful. It is filled with tips on where you can shop in Nyc and ways to get Designer labeling at discount prices, in addition to on ways to get around the town. firstcallservices

Shopping with regard to gifts has not been simpler. This is specially true should you go online to surf for your own gifts. Thousands and thousands of merchants can advertise really stunning, quality presents at sensible prices and you will shop in the comfort of the living space and laptop computer! veghealth

Everyone is actually buzzing about being enviromentally friendly these days and also the home is among the best places to begin. Since all of us spend a lot time inside our homes, it just is sensible to begin being much more eco-friendly presently there. Here, we’ll take a look at five ways your family can start being enviromentally friendly with a good eco house. seniorsinsuranceadvice

So what is it prefer to own a part of a home inside a corner from the largest wine-producing area in People from france? Imagine a number of your best wines as well as similar descriptions enter into play: background, depth, difficulty, uniqueness associated with character. How sweet it’s. shopfisher

If you are to purchase a property about the beachfront, wouldn’t you select the location that combines a developing role about the international picture with obtainable prices? Should you said indeed, consider a house or property in Cancun. lyfood

Since we’ve protected IT equipment, computer protection and catastrophe recovery (make sure you see components 1 & 2 of the series), let’s consider the vast choice of other equipment you’ll want to make points happen rapidly and efficiently in your house business. betaeducation

Luxury property in Victoria, B . C ., is truly a few of the very best on the planet. Macleans newspaper selected Victoria as the main city within Canada by which to relocate a household business. Conde Nast Criminal magazine voted Victoria the very best over-all town in Canada because of its environment as well as ambiance. childrensoralhealthohio

Dramatic changes took place within the market in Marbella. In truth over all the islands Costa delete Sol. Property here happens to be in need by N . Europeans since the climate is extremely warm as well as sunny the majority of the year and the price of living may be historically reduced. myattorneyatlaw

Buyers as well as sellers, please make sure to entrust this particular transaction to some full time property professional along with experience along with a track report. Someone who’s capable of give a person expert suggestions about homes within Summit NJ-NEW JERSEY or your own market region. buddha-yoga

During yesteryear week, the globe has witnessed a number of events which influenced the different sectors from the growing worldwide economy. Similarly, some occasions promised much more developments as well as expansion not just in the actual international trade but additionally in particular countries. ansaricapital