Last Version

scriptspider 0.3

ScriptSpider(SS) is a Java distributed crawler framework that supports hot swappable components. SS是一个java版本的分布式的通用爬虫,可以热插拔各个组件(提供默认的),自动切换代理,自动结构化数据与存储。使用redis,分布式调度等技术。

License

License

Categories

Categories

IDE Development Tools
GroupId

GroupId

com.github.xjtushilei
ArtifactId

ArtifactId

scriptspider
Version

Version

0.3
Type

Type

jar
Description

Description

scriptspider
ScriptSpider(SS) is a Java distributed crawler framework that supports hot swappable components. SS是一个java版本的分布式的通用爬虫,可以热插拔各个组件(提供默认的),自动切换代理,自动结构化数据与存储。使用redis,分布式调度等技术。
Project URL

Project URL

https://github.com/xjtushilei/ScriptSpider
Source Code Management

Source Code Management

https://github.com/xjtushilei/ScriptSpider

Download scriptspider 0.3


<!-- https://jarcasting.com/artifacts/com.github.xjtushilei/scriptspider/ -->
<dependency>
    <groupId>com.github.xjtushilei</groupId>
    <artifactId>scriptspider</artifactId>
    <version>0.3</version>
</dependency>
// https://jarcasting.com/artifacts/com.github.xjtushilei/scriptspider/
implementation 'com.github.xjtushilei:scriptspider:0.3'
// https://jarcasting.com/artifacts/com.github.xjtushilei/scriptspider/
implementation ("com.github.xjtushilei:scriptspider:0.3")
'com.github.xjtushilei:scriptspider:jar:0.3'
<dependency org="com.github.xjtushilei" name="scriptspider" rev="0.3">
  <artifact name="scriptspider" type="jar" />
</dependency>
@Grapes(
@Grab(group='com.github.xjtushilei', module='scriptspider', version='0.3')
)
libraryDependencies += "com.github.xjtushilei" % "scriptspider" % "0.3"
[com.github.xjtushilei/scriptspider "0.3"]

Dependencies

compile (9)

Group / Artifact Type Version
ch.qos.logback : logback-classic jar 1.2.3
ch.qos.logback : logback-access jar 1.2.3
ch.qos.logback : logback-core jar 1.2.3
org.slf4j : slf4j-api jar 1.7.25
org.jsoup : jsoup jar 1.11.2
redis.clients : jedis jar 2.9.0
org.apache.httpcomponents : httpclient jar 4.5.3
com.google.code.gson : gson jar 2.8.2
commons-io : commons-io jar 2.6

Project Modules

There are no modules declared in this project.