• Home
• org.archive.heritrix
• heritrix-engine
• 3.4.0-20240909
• source code
• CrawlMapper_en.utf8

×

Project download

Many resources are needed to download a project. Please understand that we have to compensate our server costs. Thank you in advance.
Project price only 1 $

You can buy this project and download/modify it how often you want.

org.archive.crawler.processor.CrawlMapper_en.utf8 Maven / Gradle / Ivy

check-outlinks-description:
Whether to apply the mapping to discovered outlinks, for example after 
extraction has occurred. 


check-uri-description:
Whether to apply the mapping to a URI being processed itself, for example 
early in processing (while its status is still 'unattempted'). 


diversion-dir-description:
Directory to write diversion logs. 


local-name-description:
Name of local crawler node; mappings to this name result in normal 
processing (no diversion). 


rotation-digits-description:
Number of timestamp digits to use as prefix of log names (grouping all 
diversions from that period in a single log). Default is 10 (hourly log 
rotation). 


outlink-decide-rules-description:
Decide rules to determine if an outlink is subject to mapping.