1. When crawling a SharePoint site can certain pages or lists be restricted from the crawl?
2. And at the opposite end can SD follow links on a web page or document and crawl that source too.
I realize that one could end up crawling the whole Internet that way . I have heard of people doing that with MS SharePoint Search only discover their SQL DB in the with massive Gigs of data.