I have a strange problem. I crawl the mails of my exchange server.
After a fresh crawl, all my mails are searchable and are found.

After a few days, the collection size is still as big at it was after the first crawl, but i can’t find most of the mails.

A recrawl is done every day.

Example:

Search for “Amazon”
after a fresh crawl ==> hundrets of hits
after a few days ==> 3 hits

I’ve installed the patch from this thread:
http://www.searchdaimon.com/forum/viewthread/985/

Is there a possibilitiy to see whats going on?

Kind regards
Dennis

At the top of my head this sounds like a crawling or garbage collection problem. When an email gets deleted from Exchange it will be removed from the ES also. However Exchange doesn’t have any mechanisms for notifying the ES that an email has been deleted. The email is just gone. The ES then have to figure out what to keep and what to delete, in a process normally referred to as “garbage collection”.

* The email you are able to see, are they old ones or relative new ones?

* In the ES administrator interface you can list the documents in a collection (manage in the overview section, then view the documents tab). Are many or all of your email listed as deleted?

* There may be information about this in the garbage collection Summary log. In the ES administrator interface can you go to Statistics & Logs-> Log files -> Garbage collection Summary-> View and copy what you find. Then send the information to: support [at] searchdaimon [dot] com so we can have a look (it shouldn’t be any privileged information in that log. Just a list of collection names and own many documents that was deleted).

* The email you are able to see, are they old ones or relative new ones?

Over the last night I’ve created a second Exchange collection, to compare the results. I can’t say that it depends on the age of the mail. Here are a few examples:

—-
Search for “Amazon”:
first Exchange collection
- 2 Hits
- oldest Feb 2012
- newest Sep 2013

second(new) Exchange collection:
- 506 Hits
- oldest Mar 2010
- newest Sep 2013
—-
Search for “slotta”:
first Exchange collection
- 40 Hits
- oldest Feb 2010
- newest Sep 2013

second(new) Exchange collection:
- 3164 Hits
- oldest Mar 2010
- newest Sep 2013
—-

Oldest and newest Mail are not the same in both results.

Here is a snipped of the garbage collection log, that includes both exchange collections:

=> EXCHNG is the second test collection (with a few less mailboxes)
2013-09-26 09:02:01: gc’ed “EXCHNG”. Keept 108876, gced 0
2013-09-26 08:58:57: Skipping “Exchange”. Was not correctly crawled.
2013-09-25 08:59:47: gc’ed “Exchange”. Keept 1722, gced 97202
2013-09-18 08:59:40: gc’ed “Exchange”. Keept 96499, gced 13754
=> manual complete crawl here
2013-09-11 08:59:37: gc’ed “Exchange”. Keept 4325, gced 107460
2013-09-04 08:58:46: Skipping “Exchange”. Was not correctly crawled.
2013-08-28 08:58:46: Skipping “Exchange”. Was not correctly crawled.
2013-08-21 08:58:57: Skipping “Exchange”. Was not correctly crawled.
2013-08-13 14:23:25: gc’ed “Exchange”. Keept 106247, gced 490
2013-08-06 14:23:21: Skipping “Exchange”. Was not correctly crawled.

Here are many crawl Errors. Between the 11. an 18. the HDD was full (resizeing has been done).
No crawl errors or massive gced documents on the other Filesystem collections.

In the logfile “Garbage collection all documents” are many mails, that are still existent but marked as deleted.

For me its looks like that the recrawls are interrupted without proper notification and the garbage collection “thinks” that the other mails are not existend anymore.

For me its looks like that the recrawls are interrupted without proper notification and the garbage collection “thinks” that the other mails are not existend anymore.

This is exactly what I think happened also. The garbage collector will not garbage collect collections that was not properly crawled, but maybe you can somehow crawl part of it in such a way that it appears to have been 100% done. At least it is where we have started to look to see if there is some kind of bug.

After you extended the disk have you seen this again, or did it happen just that one time?

*After you extended the disk have you seen this again, or did it happen just that one time?

My test-collection, EXCHNG was created after I extended the Disk. After a few days it shows the same behaviour:

2013-10-06 09:01:27: gc’ed “EXCHNG”. Keept 1016, gced 128
2013-10-05 09:01:19: Skipping “EXCHNG”. Was not correctly crawled.
2013-10-04 09:01:25: gc’ed “EXCHNG”. Keept 974, gced 243
2013-10-03 09:01:11: gc’ed “EXCHNG”. Keept 993, gced 365
2013-10-02 09:01:56: gc’ed “EXCHNG”. Keept 990, gced 108872
2013-10-01 09:00:47: Skipping “EXCHNG”. Was not correctly crawled.
2013-09-30 09:02:24: gc’ed “EXCHNG”. Keept 109471, gced 0
2013-09-29 09:00:50: gc’ed “EXCHNG”. Keept 109394, gced 0
2013-09-28 09:02:12: gc’ed “EXCHNG”. Keept 109194, gced 0
2013-09-27 09:01:20: Skipping “EXCHNG”. Was not correctly crawled.
2013-09-26 09:02:01: gc’ed “EXCHNG”. Keept 108876, gced 0

All Exchange Services are monitored by a zabbix server, there where no errors at this times.

Life looking for Chapter 7 bankruptcy is simply not as daunting any amount of would brand new think. The reality is, most belonging to the negative information you can get is spewed via the credit card issuers that get left behind when you seek bankruptcy relief protection. skincarepearls

Honesty and even integrity are essential to that building in society. A lot of these cornerstones build up prosperity and even peaceful communal order. Dishonesty and even greed can be destructive energies that rip society downward. fashionismydrug

Mongolia is known for a significant shown area designed for coal exploration sector. On Mongolia that annual fossil fuel production is without a doubt approximate around 5 huge number of metric oodles. Almost 85% about this production is commonly employed for vapor and source of electricity generation. healthbeautycare

During the last decade Taupo on New Zealand contains continued to help you attract unique house tradesman and turn out to be that only some small residential areas are declining. Read this particular blog post and then determine three the explanation why Taupo is escalating both on population volume and financially. mensmeds

There can be some easy steps you will be able to follow to improve a good lawn good care business. Knowing these procedures, it is extremely important to often remind yourself of those or you might find that yourself declining and gently lose people. interior2han

Home well-being service at present offers a lot of to patients which are recuperating as a result of surgery and illness. These expertise offered help patients to recoup comfortably to their own family home, without worrying families just who can’t provide a lot of services. fatburningfurnacereport

Outlined in this article I show you research As i conducted for you to understand how come people believe healthy food choice is now more expensive rather than unhealthy diet. I examine the details I held and form a viewpoint good results as a result of my piece. insurancehealthquote

Narrowly classified, “moderate drink consumption” stabilises health hazard from heart disease. But the application raises hazard for distinct cancers, hepatitis, weakening of bones, immune reductions, accidents, and even suicide. Hi-def tell one that area. intuitionandhealing

The second portion of getting sickly is fussing considering the health insurance plans claims operation. I involve some tips to help you pass-on from my own ring health cases experiences that would help one navigate it maze. dailyhealthtrends

Changes with the health good care environment can be here. Simply because physician management, are you in a position to build tough, flexible health reform teams they’ll thrive? Three procedures are presented outlined in this article that might position you and unfortunately your team to achieve success. salesmanagementsystems

Many home-owners are taking out high must have grass of their yards and deciding on a excitement garden in its place. If you just aren’t ready to quit on ones own green flooring, here can be some advise for a a nourishing green, dandelion free back garden. cheapclothesshoppingonline

Education designed for Sustainable Creation (ESD) is known as a rather unique field in education. You can easily see it being a innovative type future degree for academic institutions linking that child’s development considering the future conflicts of contemporary culture. ehealthplanners

There is a small class of young Americans which are already gaining education to another country. They earn credits on the way to their degree at an important cheaper rate, get to discover the everyday life overseas and even travel available Asia. heavenhomes

Learn about here how come large organisations, small varieties and professionals each is gaining cloud internet business computing for an assortment of reasons. The foriegn system is without a doubt described and even predictions were created for the nation’s future file format. gloucesterplumbing

Law is simply not the starting out place, nor that could be the ceasing place concerning ethics. Our meaningful ideas commonly shape the smoothness of much of our laws. Criticism in laws and even proposals designed for change individuals laws are frequently based for the shared meaningful ideal which is not being gained. weightlossshakeshq

This article is actually directed within men though ladies to comment then simply feel 100 % free! Understand everything that it is a individual! I’m not revealing what one learned in your dad or buddies, what Air cleaner will add is how i as of the male gender project you to ultimately others. prolawteam

This the ENGLAND winter delivered a great freeze, this was unusual, as a good number of winters within the uk are federal reserve by soft westerly winds belonging to the Atlantic beach, but the winter of 2009/2010 was to remain much unlike normal. clubsimenahotel

Fashion is known for a rippling result on people as a result of different takes of everyday life. It slowly and gradually gains worldwide recognition among distinctive strata in society. To allow fashion find the users, a many of the professionals are essential. certifiedhealthcoach

Shopping designed for camping chairs could seem simple good enough, but knowing the ideal places to be can assist you find the person you require while helping you save both precious time and bucks. Hint: don’t start up your search around the supermarket! marketyourpractice

Food shopping for the budget? As you enter any specific supermarket, you certainly will fall recipient to selling. Marketing in actual fact the clearly researched discipline of why is people order. Don’t set the selling trap. Here can be 14 bright tips to help you to save 10—15% from your money once food hunting… beautyandstyling

The Pappa Rocking Beach destination Chair is from where the beach accommodates the porch! So if you are searching for a beach styling chair that moves likes an important porch chair it is light, handheld and folds over flat, then it beach chair is definitely the one for everyone! safeguardfinancialusa

If you may be like all of us and take pleasure in designer wardrobe at reduction prices then you can get this guide useful. It is rife with tips on the best places to shop in New york and the best way Designer is manifest on at cut price prices, plus on the best way around the metropolis. firstcallservices

Shopping designed for gifts has not been simplier and easier. This is specially true if you happen to go online to look for ones own gifts. A huge number of merchants can sell really exquisite, quality the right gifts at practical prices as well as shop belonging to the comfort from your living living room and laptop or pc! veghealth

Everyone is without a doubt buzzing about earth-friendly these days additionally, the home belongs to the best places to implement. Since you spend a lot of time in your homes, it just seems sensible to start up being alot more eco-friendly truth be told there. Here, we’ll look into five ways friends and family can start earth-friendly with a powerful eco family home. seniorsinsuranceadvice

So precisely what is it always like to own component to a home at a corner belonging to the largest wine-producing community in France? Imagine a bit of your most interesting wines and even similar descriptions creep into play: past, depth, sophiisticatedness, uniqueness in character. How sweet it will be. shopfisher

If were you to to order a property in the beachfront, wouldn’t you want the set that combines a growing role in the international scenario with on hand prices? If you happen to said absolutely yes, consider a residence or flat in Cancun. lyfood

Once we’ve blanketed IT computer, computer reliability and accident recovery (satisfy see segments 1 & 2 about this series), let’s look into the vast variety of other odds and ends that you must make stuff happen promptly and efficiently in the house business. betaeducation

Luxury the property market in Victoria, B . C ., is truly the various very best on this planet. Macleans periodical selected Victoria as the top city on Canada that to relocate family portrait business. Conde Nast Tourist magazine voted Victoria the ideal over-all place in Canada for their environment and even ambiance. childrensoralhealthohio

Dramatic changes took place with the housing market in Marbella. In certainty over all the islands Costa delete Sol. Property here is actually in interest by N . Europeans given that the climate is amazingly warm and even sunny almost all the year and the fee for living was historically cheap. myattorneyatlaw

Buyers and even sellers, please ensure that you entrust it transaction to somewhat of a full time the property market professional through experience together with a track listing. Someone who might be allowed to give one expert suggestions about homes on Summit NEW JERSEY or ones own market community. buddha-yoga

During history week, the universe has witnessed some events which will influenced the variety of sectors belonging to the growing intercontinental economy. Similarly, some occurrences promised alot more developments and even expansion not alone in that international trade but probably in exact countries. ansaricapital