• Home
• com.github.xbynet
• crawler-core
• 0.3.0
• source code
• DuplicateRemover.java

×

Project download

Many resources are needed to download a project. Please understand that we have to compensate our server costs. Thank you in advance.
Project price only 1 $

You can buy this project and download/modify it how often you want.

com.github.xbynet.crawler.scheduler.DuplicateRemover Maven / Gradle / Ivy

package com.github.xbynet.crawler.scheduler;

import com.github.xbynet.crawler.ISpider;
import com.github.xbynet.crawler.Request;

public interface DuplicateRemover {
    public boolean isDuplicate(Request request, ISpider spider);
    public void resetDuplicateCheck(ISpider spider);
    public int getTotalRequestsCount(ISpider spider);

}