• Home
• org.archive.heritrix
• heritrix-engine
• 3.4.0-20240909
• source code
• SupplementaryLinksScoper_en.utf8

×

Project download

Many resources are needed to download a project. Please understand that we have to compensate our server costs. Thank you in advance.
Project price only 1 $

You can buy this project and download/modify it how often you want.

org.archive.crawler.postprocessor.SupplementaryLinksScoper_en.utf8 Maven / Gradle / Ivy

description:
SupplementaryLinksScoper. Use to do supplementary processing of in-scope links.
Will run each link through configured filters.  Must be run after LinkScoper 
and before FrontierScheduler. Optionally logs rejected links (Enable 
override-logger-enabled and set logger level at INFO or above).


link-rules-description:
DecideRules which if their final decision on a link is REJECT, cause the
link to be ruled out-of-scope, even if it had previously been accepted
by the main scope.