JarCasting
JarCasting JarCasting

com.github.ancienter:webmagic-core

A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.

License

License
Categories

Categories

webmagic Business Logic Libraries Web Crawling
GroupId

GroupId

com.github.ancienter
ArtifactId

ArtifactId

webmagic-core
Last Version

Last Version

v2020.6.17
Release Date

Release Date
Type

Type

jar
Description

Description

A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.

Download webmagic-core

Filename Size
webmagic-core-v2020.6.17.pom
webmagic-core-v2020.6.17.jar 96 KB
webmagic-core-v2020.6.17-sources.jar 58 KB
webmagic-core-v2020.6.17-javadoc.jar 440 KB
Browse

How to add to project

<!-- https://jarcasting.com/artifacts/com.github.ancienter/webmagic-core/ -->
<dependency>
    <groupId>com.github.ancienter</groupId>
    <artifactId>webmagic-core</artifactId>
    <version>v2020.6.17</version>
</dependency>
// https://jarcasting.com/artifacts/com.github.ancienter/webmagic-core/
implementation 'com.github.ancienter:webmagic-core:v2020.6.17'
// https://jarcasting.com/artifacts/com.github.ancienter/webmagic-core/
implementation ("com.github.ancienter:webmagic-core:v2020.6.17")
'com.github.ancienter:webmagic-core:jar:v2020.6.17'
<dependency org="com.github.ancienter" name="webmagic-core" rev="v2020.6.17">
  <artifact name="webmagic-core" type="jar" />
</dependency>
@Grapes(
@Grab(group='com.github.ancienter', module='webmagic-core', version='v2020.6.17')
)
libraryDependencies += "com.github.ancienter" % "webmagic-core" % "v2020.6.17"
[com.github.ancienter/webmagic-core "v2020.6.17"]

Dependencies

compile (10)

Group / Artifact Type Version
org.apache.httpcomponents : httpclient jar 4.5.12
org.apache.commons : commons-lang3 jar 3.10
us.codecraft : xsoup jar 0.3.1
org.slf4j : slf4j-api jar 1.7.30
org.slf4j : slf4j-log4j12 Optional jar 1.7.30
commons-collections : commons-collections jar 3.2.2
org.jsoup : jsoup jar 1.10.3
org.apache.commons : commons-io jar 1.3.2
com.jayway.jsonpath : json-path jar 2.4.0
com.alibaba : fastjson jar 1.2.68

test (4)

Group / Artifact Type Version
junit : junit jar 4.13
com.github.dreamhead : moco-core jar 1.1.0
org.mockito : mockito-all jar 1.10.19
org.assertj : assertj-core jar 3.16.1

Project Modules

There are no modules declared in this project.

Versions

Version
v2020.6.17