• Home
• org.archive.heritrix
• heritrix-engine
• 3.4.0-20240909
• source code
• BdbFrontier_en.utf8

×

Project download

Many resources are needed to download a project. Please understand that we have to compensate our server costs. Thank you in advance.
Project price only 1 $

You can buy this project and download/modify it how often you want.

org.archive.crawler.frontier.BdbFrontier_en.utf8 Maven / Gradle / Ivy

description:
A Frontier using BerkeleyDB Java Edition databases for persistence to disk.

bdb-description:
The bdb module to use for the frontier.

uri-included-structure-description:
URI-already-included to use (by class name) 

dump-pending-at-close-description:
If true, dump all URIs waiting in queues to crawl.log when a crawl ends. May add a significant delay to crawl termination. Dumped lines will have a zero (0) status. Default is false.