JarCasting
JarCasting JarCasting

cn.spark2fire:jscrapy-core

A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.

License

License
GroupId

GroupId

cn.spark2fire
ArtifactId

ArtifactId

jscrapy-core
Last Version

Last Version

0.0.1
Release Date

Release Date
Type

Type

jar
Description

Description

A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.

Download jscrapy-core

Filename Size
jscrapy-core-0.0.1.pom
jscrapy-core-0.0.1.jar 97 KB
jscrapy-core-0.0.1-sources.jar 59 KB
jscrapy-core-0.0.1-javadoc.jar 493 KB
Browse

How to add to project

<!-- https://jarcasting.com/artifacts/cn.spark2fire/jscrapy-core/ -->
<dependency>
    <groupId>cn.spark2fire</groupId>
    <artifactId>jscrapy-core</artifactId>
    <version>0.0.1</version>
</dependency>
// https://jarcasting.com/artifacts/cn.spark2fire/jscrapy-core/
implementation 'cn.spark2fire:jscrapy-core:0.0.1'
// https://jarcasting.com/artifacts/cn.spark2fire/jscrapy-core/
implementation ("cn.spark2fire:jscrapy-core:0.0.1")
'cn.spark2fire:jscrapy-core:jar:0.0.1'
<dependency org="cn.spark2fire" name="jscrapy-core" rev="0.0.1">
  <artifact name="jscrapy-core" type="jar" />
</dependency>
@Grapes(
@Grab(group='cn.spark2fire', module='jscrapy-core', version='0.0.1')
)
libraryDependencies += "cn.spark2fire" % "jscrapy-core" % "0.0.1"
[cn.spark2fire/jscrapy-core "0.0.1"]

Dependencies

compile (9)

Group / Artifact Type Version
org.apache.httpcomponents : httpclient jar 4.5.13
org.apache.commons : commons-lang3 jar 3.11
us.codecraft : xsoup jar 0.3.2
org.slf4j : slf4j-api jar 1.7.30
org.slf4j : slf4j-log4j12 Optional jar 1.7.30
commons-collections : commons-collections jar 3.2.2
commons-io : commons-io jar 2.8.0
com.jayway.jsonpath : json-path jar 2.5.0
com.alibaba : fastjson jar 1.2.75

test (4)

Group / Artifact Type Version
junit : junit jar 4.13.1
com.github.dreamhead : moco-core jar 1.1.0
org.mockito : mockito-all jar 1.10.19
org.assertj : assertj-core jar 3.18.1

Project Modules

There are no modules declared in this project.

jscrapy

Based on webmagic, scrapy for java

Versions

Version
0.0.1