Search Appliance
Syntax: select Yes or No button
Allow retrieval of individual off-site pages. By default the Search Appliance will not retrieve pages that are not on the same host as the base URL(s). Using this option, pages not on the same machine will be retrieved, but none of the pages that they reference will be walked.
All other discarding rules don't involve the site except for Stay Under still apply (Extensions, Exclude Prefix, Required Rex, etc).