Configuring Crawler Impact Rules
Crawler impact rules can be used to calibrate the aggressiveness of your crawl efforts. The default settings ask for eight documents in a single request and then wait 0 seconds before asking for another eight documents after the first set of documents has been received. You can change both the number of documents in a single request (up to 64 documents) and insert a wait period between requests, configured in seconds.
You may need to calibrate how quickly and aggressively SharePoint Server crawls a content source to ease the burden on the target server. In addition, you may also need to configure one or more rules to help ease the burden of the crawl procedures on the Web front-end servers in your farm. This is ...
Get Microsoft® SharePoint® Products and Technologies Administrator's Pocket Consultant now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.