• Home
• org.archive.heritrix
• heritrix-engine
• 3.4.0-20240909
• source code
• BucketQueueAssignmentPolicy_en.utf8

×

Project download

Many resources are needed to download a project. Please understand that we have to compensate our server costs. Thank you in advance.
Project price only 1 $

You can buy this project and download/modify it how often you want.

org.archive.crawler.frontier.BucketQueueAssignmentPolicy_en.utf8 Maven / Gradle / Ivy

description:
Uses the target IPs as basis for queue-assignment,
distributing them over a fixed number of sub-queues.
Contributed to Heritrix by Christian Kohlschütter. 

server-cache-description:
Crawler's global ServerCache instance; used to lookup host IP. 
Should be left auto-filled.