Download scriptspider JAR file with all dependencies
scriptspider from group com.github.xjtushilei (version 0.1.1)
ScriptSpider(SS) is a Java distributed crawler framework that supports hot swappable components.
SS是一个java版本的分布式的通用爬虫,可以热插拔各个组件(提供默认的),自动切换代理,自动结构化数据与存储。使用redis,分布式调度等技术。
Artifact scriptspider
Group com.github.xjtushilei
Version 0.1.1
Last update 12. April 2017
Tags: that redis swappable distributed java supports components scriptspider framework crawler
Organization not specified
URL https://github.com/xjtushilei/ScriptSpider
License The Apache Software License, Version 2.0
Dependencies amount 9
Dependencies logback-classic, logback-access, logback-core, slf4j-api, jsoup, jedis, httpclient, gson, commons-io,
There are maybe transitive dependencies!
Group com.github.xjtushilei
Version 0.1.1
Last update 12. April 2017
Tags: that redis swappable distributed java supports components scriptspider framework crawler
Organization not specified
URL https://github.com/xjtushilei/ScriptSpider
License The Apache Software License, Version 2.0
Dependencies amount 9
Dependencies logback-classic, logback-access, logback-core, slf4j-api, jsoup, jedis, httpclient, gson, commons-io,
There are maybe transitive dependencies!
Page 1 from 1 (items total 1)