I’m running into a problem with one SMB share in particular that I’m not able to index. Here’s what I see in the crawlManager.log:

Aug 2 08:30:13 searchdaimon crawlManager[3453]: ERROR: Starting crawl of collection “ProductDev” (id 203).
Aug 2 08:30:13 searchdaimon crawlManager[3453]: ERROR: documentError: level: 1
Aug 2 08:30:13 searchdaimon crawlManager[3453]: ERROR: crawlsmb.c: Error! Could not get attributes for //192.168.238.249/ProductDev/Documents/Review.ppt. Unknown error code “-1”

That last line then repeats for every file in the share. I do in fact have access to all of these files, and I had no problem indexing our other shares. I don’t see anything unusual when looking at the file permissions in Windows.

Could not get attributes for //192.168.238.249/ProductDev/Documents/Review.ppt. Unknown error code “-1”

I have looked in the code and that error is thrown when the crawler can’t look up security permission (acl information on Windows, owner and group information on Linux). I am not sure what permissions one need to have been granted to be able to read who else are allowed to interact with a file, but I would guess that read should be sufficient, so this is strange.

It is also strange that you get a a “Unknown error”, and not one of the known one this function can give:

*The client library is not properly initialized or one of the parameters is not of a correct form.
*Permission was denied.
*The referenced file system does not support extended attributes.
*No memory was available for internal needs.

What is the underling source for the SMB share? Is it a Windows server, Linux server, dedicated NAS etc.

What file system dos the underlying source use? NTFS, EXT3 Fat16, FAT32 etc.

Is the server/NAS connected to Active Directory?

I believe it’s a Windows server formatted with NTFS, but I’m not 100% positive. I’ll try to get you an answer.

It is connected to an Active Directory.

I found one instance where a single file in a directory gave this error (on a different share) but other files in the directory worked fine, so I dug into that one… The only difference I see is that all other files in that directory inherited permissions from the parent. The one with issues both inherited permissions AND has a single user override (so when looking at advanced permissions, I see the same user listed twice - once as inherited from parent and once as <not inherited>. The inherited were read-only for this user, and the override was full permissions.

What’s interesting to me is that I can see all the permissions from my windows account. I’m using my own account in the search engine config for this share, but it reports an error. I suspect perhaps your error message is misleading, but that’s just a guess.

I’ve confirmed - this is a Windows server hosting the share and it’s formatted with NTFS.

Ok - I think I’ve got it. Within a SMB file share, have a directory with a bunch of people and groups set in permissions. (Give Bob full control) Within that directory, have a file that inherits permissions from the parent. All works well.

Modify the file to include special permissions. Add Bob (again) and give him full control. Rename the file (so it’s picked up again by the search engine) and recrawl the directory, and you get the error.

Rename the file to something new again, remove the special permission for Bob (so it’s back to Inherit from parent), and reindex. The error goes away and the file is indexed properly.

Great find! I will try to simulating this in our end, and see what we can do about it.

Bdw: This is a classic example on why building a enterprise search engine is so hard. Many think that it is the search system that is hard to make, but really it is the integration part. Probably are neither Windows nor the SMB software optimized for showing permissions correctly in all situations. It is most commonly used used by end-user browsing around in the file tree at slow speed. Only occasionally viewing the permissions of a file. As long as the only gets to open the files they has permissions on everything is great for them.

The ES on the other hand has to read all the files and all the permission without any failures. We therefore has to be very cautious and newer include a file if it is even a slightly hint that something failed, because it is better that people don’t find a file, then they get to see one they don’t have permission for.

(This is one of the reason we have the online right check for SMB you already have had a run in with. We want to be 100% sure, and it easier for the server to answer if a particular user has access then to list all users that has access)

Hopefully, with big data and all, vendors will start to make better interfaces for extracting data at scale. In the meantime we will have to fix this one bug at a time…

Again thank you for reporting this. We will try to fix it

I suspect there may be another bug that I have yet to pinpoint… I’m seeing this error in two places - in a share that it’s properly indexing except for a few files (which is what I posted the instructions for reproducing above for), and in a share that it traverses everything for but indexes nothing at all (reporting that error for every file). Looking at the 2nd scenario, I don’t see the permission abnormality I’m seeing with the first item. Hopefully your fix resolves both - but since I can’t tell you what causes the second, I’m a bit doubtful this will solve everything.

Thank you very much for putting the effort into getting these resolved. Your efforts are greatly appreciated, and you have a terrific product!

Therefore listed below are the reasons I do believe most people submit an application for the bloggers’ survival program: Many bloggers are usually misinformed; Many bloggers are usually lazy; Many bloggers shortage skills; Many bloggers shortage Commitment; Many bloggers shortage business attitude. legendsoflaw.net

From the particular BlackBerry for the light bulb for the telephone, Canadian technology are an integral part of the every day life of the entire world. But most result in US centered companies. We rely down the most notable ten Canadian technical inventions in which stayed only at home. financeformanagers.net

Consultation of Ruth Porat, since Chief Economic Officer with Google, could be symbolized as a possible empowerment regarding women inside tech marketing and advertising jobs. Yet, it’s sad that glory will be dimmed down with all the actual info showing the particular decline inside the ratio regarding tech careers held simply by women. medicomtech.net

Getting the business known inside the local area may be hard. Maybe you have put the basic principles in spot? Follow these kinds of five basic local SEARCH ENGINE MARKETING principles to begin with to obtain the exposure your organization needs. charterschoolpolicy.org

Maybe you have faced the situation of finding the right puppy house? Although countless of models flood industry now, choosing the dog house may be tough, especially when you’ve got a distinct design at heart or when you are interested in some really unique puppy house. thebeautyresource.net

Hollywood with the North. There’s justification why Vancouver will be honoured with this kind of glamourous pseudonym. All things considered, it is a huge filmmaking centre for pretty much a millennium. savenow4college.org

Traveling in another country is expensive. Some vacation companies take your cash and don’t manage the trip effectively. Some methods for contemplating how to pick a business that cares for your traveler beneath their observe. bkkshopping.net

Faith, desire, and love will be the components regarding life. These a few alone acquire us from point out point inside our lives, and offer us the opportunity to live the particular virtuous living. With these kinds of three we’re able to move inside alignment for the will regarding God. top—designer-brands.net

Finding vacation deals inside Europe can be a general topic but some very apparent paths to check out. Lose them and you will be lost into a huge world regarding not intriguing opportunities. 1000s of offers are on the market, with extremely tight rates one together. lifestyle-navi.net

Earlier through the 19th millennium in Austria, people used horse driven carriages regarding transportation. There have been obviously simply no wristwatches during those times. So brass carriage clocks were utilized to record time. womenfashionblog.net

Internet internet marketers discuss the device they uses inside their SEO strategies to log what kind of traffic programs they switch on when traveling traffic with a new website. They furthermore outline the particular default items they like regarding the content which they generate. 7jewelry.net

Discovering the right person with an Infertility Counselling with can be quite a daunting process. But once you’ve chosen the proper person, you will end up amazed at everything you can understand. There are usually many facts to consider when picking a therapist. shop24hr.net

Mobile Prize Hunt Advertising can be a new marketing and advertising concept. It permits advertisers that will put their brand names, ads and also free special gifts onto an international prize guide for cell users to get via GPS DEVICE. thepetcompanion.org

Today, the sporting activities industry is reported to be the eleventh largest market in United states of america, producing greater than $213 thousand annually. This is a growing and also diverse industry, including numerous segments just like professional clubs, private and also public agencies, en-architects.net

There are usually many car insurance alternatives online. Yet before getting, try to find various websites and acquire quotes coming from different insurance firms for your car or truck. Of course being a consumer, you would like to have recommended of the purchase price ranges in the marketplace. dressydresses.net

Growing amount of people today count on services that provide hassle totally free recovery regarding assets and also bring answers to long approaching cases linked to locating shareholders, heirs to be able to estates, buyers, due refunds, and so forth. visonictech.org

As engineering becomes a more impressive part individuals children’s lifestyles, pediatricians are usually seeing a growing number of young individuals for recurring stress accidents. How can easily parents help alleviate problems with injury? cardsforbusiness.net

Factors in which influence the particular fee and the expense of real est management. What exactly is the difference involving the fee as well as the cost? The payment is everything you sign inside the real est management deal whereas the fee is the quantity you must pay over summer and winter to get the service you will need. sdgl-edu.com

Traveling can be an interesting activity. Travelers have the main benefit of learning and also gathering information about different areas. Not only which they see and also explore diverse places nevertheless they also understand those areas intentionally along with unintentionally. house-blueprints.org

Medical Payment technology provides witnessed continuing expansion through the first two months of come early july, as confirmed by pr announcements about several ninety goods accumulated inside BillingWiki. A training manager may battle to select the most effective product from this kind of large merchandise variety. newharbortech.com

If you are interested in luxury real-estate for selling, then it will be good selection to look online. The world wide web is filled up with plenty of information regarding real-estate for the precise area you would like to buy inside. There may also be plenty of real estate agents online who can help you in the hunt. returneeshome.com

Did you know there are usually over fifty-five, 000 plumbers inside the state regarding California? In the event you did not necessarily, then an individual likely recognize that this career is swiftly growing inside popularity. A plumbing technician can make $16 to be able to $35 and sometimes more one hour good field and also years regarding training. simplythebusiness.net

It is possible to increase the particular sales of one’s company by working together with manufacturer’s representatives or self-sufficient sales representatives. This online strategy is fantastic for small companies as you only pay out your merchant based about performance. Listed below are the essentials. businesstrainingteam.net

Whenever we speak about fashion, a optimally hot seeking lady starts off reverberating inside our mind. The real reason for this will be fashion can be a replica regarding beauty, cosmetics and type, that is most beneficial seen inside women. Nonetheless it doesn’t signify male are usually behind the fashion scene. managementconsultingbusiness.net

Your basic sense regarding fashion actually isn’t asking everything that much can it be? Trying to check good frequently is not this kind of bad thing specially when many societies are designed on initial impressions. It doesn’t matter what you do to get a living or perhaps what school you went along to, looking your better is crucial. finance-perso.net

When it concerns creating any happy residence, most folks recognize the value of habits, diet, and also health. But these critical indicators are only area of the equation. Sometimes people believe if everyone in the home loves the other person enough, pleasure will merely happen. Sadly, that’s not at all times true. acceptbusiness.net

A small business law contract is employed between a couple of entities, typically both organizations, to summarize the scope of your arrangement, agreement or perhaps deal involving the two organizations. If you might be about to access a deal agreement together with another enterprise, here certainly are a few things you ought to be cautious about. handybusiness.net

Understanding the particular acceptance process in just a Jamaica real-estate sales contract is essential to just what maintains among signing and also taking possession with the property. If virtually any party entered in to a contract, they must be aware of the dynamics and mode of your acceptance. registermylocalbusiness.net

For each and every disease, we expect to discover a corresponding treatment and therapy. However, even with the main advantage of advanced engineering, cure remains not designed for many conditions. The treatments for Straight down syndrome are among that. social-finance.org

How an individual decorate your property can be extremely important in your emotional well-being. Your surroundings supply a daily expression to who you might be and how you determine to live. A well-planned internal decor may enhance your perception of well-being along with be remarkable to website visitors. successeducationsystem.com