Hi,

For testing purposes I wanted to index some structured text data we have stored in our SQL database but then I found out there is no appropriate connector. I than decided to export the database data as a series of .txt files and run a normal SMB crawler and it worked. But there is just one thing I can’t figure out. Is it possible to add meta information to a .txt?

Thx

For testing purposes I wanted to index some structured text data we have stored in our SQL database but then I found out there is no appropriate connector.

You can index databases by writing a connector and use Perl dbi ( http://dbi.perl.org/ ). A standardized connector for databases is hard to make because the table format is different in different applications.

Is it possible to add meta information to a .txt?

Yes, the ES do support adding arbitrary meta information by custom crawlers. For example this is the search hit from an email:

Num receivers, To and From are such meta information.

To use this you would have to create your own crawler as described at http://www.searchdaimon.com/documentation/C36/ . Then add the meta information by supplying it to the add_document() routine (there are a special parameter named “attributes” for this).

Of course creating your own crawler may be a little overkill. Maybe there is a way to incorporate the data into your existing txt files?

Do you have an example on what data you need to add?

Ps: Thinking about this it occurred to me that Searchdaimon should add support for custom meta-tags in html files. Then you could do something like:

Much easier than have to learn the Searchdaimon connector framework

You can index databases by writing a connector and use Perl dbi ( http://dbi.perl.org/ ). A standardized connector for databases is hard to make because the table format is different in different applications.

I will take a look at that, thanks.

Ps: Thinking about this it occurred to me that Searchdaimon should add support for custom meta-tags in html files. Then you could do something like:

<meta name="To" content="someone@example.com" scheme="search-attribute"> 

Much easier than have to learn the Searchdaimon connector framework

Waw that would be ideal! But when you say “Searchdaimon should add support” does that mean it is not yet supported?

Waw that would be ideal! But when you say “Searchdaimon should add support” does that mean it is not yet supported?

Yes, unfortunately no support for that yet. But it is a great idea.

What kind of mete data do you need to add?

Runar Buvik - 11 January 2013 05:08 PM

What kind of mete data do you need to add?

Well at least the major data types: Text, Integer, Date.
At the end of the day I’d like to be able to do something like this:

<meta name="PublishDate" content="2011-10-10" scheme="search-attribute"> 
<meta name="Insitution" content="Blabla" scheme="search-attribute"> 
<meta name="PublishNumber" content="24" scheme="search-attribute"> 

Maybe there should also be a DataType sttribute

<meta name="PublishDate" content="2011-10-10" dataType="Date" scheme="search-attribute"> 

Not primarily does a reduced interest speed mean lower monthly payments but it will likewise save one substantial money with the life from your mortgage. However simply finding the best rates will be difficult unless you have some very nice mortgage speed shopping help. shoppingadvice

Everyday is known as a day around the beach! ” given that the old just saying goes, even though we all assume we find it difficult to really spend day after day at that beach. Then again, you will be able to experience day after day at that beach through beach house hold decor. housedecor

Thanks to it’s full heritage, nice friendly many people and unspoiled makeup, Cambodia is known as a fabulous spot for expensive tours. luxurytour

An important fashion famous is a friend or relative whose wardrobe, hair, or in general appeal was imitated as a result of everyone and allows survived models after. fashionicon

And that is exactly what counts quite possibly the most. Once one develop it healthy common practice and stay with it consistently, planning over your good day the night time before results in being your ritual and also pounds might really start up falling off your physique. healthyday

Why you should have professional regulations advice from accident injury is known as a query of a lot of throughout the globe. This question is simply not limited to help you any community or area as accidental injuries occur everywhere and people would you like about practitioners. lawadvice

The emergence belonging to the Internet to provide a booming niche outlines your requirement for web based shopping blogging. All clients resort with the Internet when we wish to pick together something unique. shoppingblog

When it pertains college being, the charitable student lodging development option is oftentimes overlooked. Then again, there are benefits to really going this method, starting considering the development’s essential focus: that young faculty scholar. housedevelopment

You will find numbers of problems that make the vacation just which will bit more desirable when choosing any such travel. Every of beneficial that As i find generate a very good small cluster tour. grouptour

Personal Bags have been completely around for tens of thousands of years. Bags make up a mixture of technological and even social changes additionally they express interpersonal advancements on fashionable provisions. fashionkeeper

How good insurance is ıs dependent upon how clearly it suits whomever. But, if contemplating a place to begin, it may just be good to visit these three or more top medical insurance coverage providers to start with. tophealth

According with the Law in Attraction, you’re to be a giant magnetic field pulling into your way of life whatever you look at. You will be able to apply it basic principle belonging to the Law in Attraction to create out the ideal in many others. lawcafe

Now 24 hours in the days of financial state investing in unnecessary things is known as a very unwise right decision. With that recent belt shrinking measures in governments internationally shopping designed for non-essential things is known as a very bad route to take. shoppingguru

The simplest to improve your private home security may be to install a backyard camera reliability camera strategy. It is to achieve and more inexpensive than you’ve probabably heard. Read on to read more about the most impressive there is without a doubt. improveyourhomes

This is did you know the creative travelling blogs which read and even follow. They are really written as a result of independent travelling writers, the catalog include individuals who I give some thought to as heavy-weights on travel writing. drtravel

A unique series within the world in fashion additionally, the top stylish labels comprise it. Each setting up will look at a huge top designer brand, the nation’s mission, and the history. Individuals first setting up we look into Virgins, New orleans saints, and Angels. fashionsaint

Marketing any specific business traditionally with internet business cards and offer fliers should really be in your strategy. These can be two great think about real universe non-internet promotional possibilities which you could take advantage of today. anybusiness

Law work are being among the most satisfying and even fulfilling work around. Winning an incident is enjoy striking gold incase you, a good way know justice was served, and all thanks to your 6-pack abs, you believe absolutely very good. lawcareer

It is without a doubt never prematurily . to start up your The yuletide season shopping. The bright shoppers know which you could already perspiring the sizzling hot products can be this show up. Use much of our list to help you to avoid that rush. shoppingnow

Rapidly reasons why look at a not much more luxury in the house, the luxury home and garden tips can offer the options on how to start. luxuryhomeimprovement

By diagnosing multiple situations which may confront leaders to their career trail, this guide brings to concentrate forcefully which will leadership style may not be static for one leader and will eventually require them all wearing distinctive leadership less difficult, suiting an assortment of situations. stylekeeper

For the considering registering with the jet-to-let owning a home set and listed below are the three or more main available choices concerning raising the property market finance, loans and mortgages to own property in foreign lands. localfinance

Well, take more time to learn about your rights and be able to flip that antics back in the debt enthusiast. This tutorial from Credit card debt negotiation Legal Guides will disclose how. legalguide

The exact same applies on home improving; such modest changes can offer your home an alternative and advanced look. This may enhance that living environment from it. A simple home and garden guide can achieve great stuff for more desirable living. homeimprovementguide

Travelers have choose learning and even gathering is critical to get different websites. Not only they can see and even explore distinctive places but they also also study those websites intentionally plus unintentionally. toptravelers

Free magazine-style web log themes could actually help your websites look sleek and competent. You don’t demand high-priced site owner to update your internet-site. Here can be five reasons to here is another new web log theme and template. styleblog

B2B sites are best for developing start up business communities and maintain improved relationships with up-to-date business correspondents. It moreover helps on reducing the time period cycle related to making acquisitions easily designed for the people. gobusiness

The equivalent laws be found today which in impression yesterday and you will be tomorrow. When you enact what the law states today rue . change last week but will spread an improved upon experience designed for tomorrow. lawtoday

It is without a doubt of very good importance once searching to find home change for the better loans that you really do various legwork to verify you perspiring is best for everyone. If you now have the large home and garden project coming your method finding the ideal home loan will be just the things you need. besthomeimprovement

Travelling will be an enjoyable go through. It is often an even more desirable experience if you happen to prepare for one’s journey, and and purchasing travel cover, there is a host in other steps you can take to better plan your adventure. travel101