us.codecraft:webmagic-core

A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.

License	Apache License, Version 2.0
Categories	webmagic Business Logic Libraries Web Crawling
GroupId	us.codecraft
ArtifactId	webmagic-core
Last Version	0.7.5
Release Date	Jul 22, 2021
Type	jar
Description	A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.

Download webmagic-core

Filename	Size
webmagic-core-0.7.5.pom
webmagic-core-0.7.5.jar	93 KB
webmagic-core-0.7.5-sources.jar	54 KB
webmagic-core-0.7.5-javadoc.jar	413 KB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/us.codecraft/webmagic-core/ -->
<dependency>
    <groupId>us.codecraft</groupId>
    <artifactId>webmagic-core</artifactId>
    <version>0.7.5</version>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/us.codecraft/webmagic-core/
implementation 'us.codecraft:webmagic-core:0.7.5'

Gradle Kotlin

// https://jarcasting.com/artifacts/us.codecraft/webmagic-core/
implementation ("us.codecraft:webmagic-core:0.7.5")

Apache Buildr

'us.codecraft:webmagic-core:jar:0.7.5'

Apache Ivy

<dependency org="us.codecraft" name="webmagic-core" rev="0.7.5">
  <artifact name="webmagic-core" type="jar" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='us.codecraft', module='webmagic-core', version='0.7.5')
)

Scala SBT

libraryDependencies += "us.codecraft" % "webmagic-core" % "0.7.5"

Leiningen

[us.codecraft/webmagic-core "0.7.5"]

Dependencies

compile (9)

Group / Artifact	Type	Version
org.apache.httpcomponents : httpclient	jar	4.5.13
org.apache.commons : commons-lang3	jar	3.11
us.codecraft : xsoup	jar	0.3.2
org.slf4j : slf4j-api	jar	1.7.30
org.slf4j : slf4j-log4j12 Optional	jar	1.7.30
commons-collections : commons-collections	jar	3.2.2
commons-io : commons-io	jar	2.8.0
com.jayway.jsonpath : json-path	jar	2.5.0
com.alibaba : fastjson	jar	1.2.75

test (4)

Group / Artifact	Type	Version
junit : junit	jar	4.13.1
com.github.dreamhead : moco-core	jar	1.2.0
org.mockito : mockito-all	jar	1.10.19
org.assertj : assertj-core	jar	3.18.1

Project Modules

There are no modules declared in this project.

Versions

Version
0.7.5 Jul 22, 2021
0.7.4 Oct 26, 2020
0.7.3 Jul 30, 2017
0.7.2 Jun 17, 2017
0.7.1 Jun 4, 2017
0.7.0 May 29, 2017
0.7.0.alpha May 20, 2017
0.6.1 Jan 21, 2017
0.6.0 Dec 18, 2016
0.5.3 Jan 21, 2016
0.5.2 Jun 4, 2014
0.5.1 May 2, 2014
0.5.0 Apr 27, 2014
0.4.3 Mar 13, 2014
0.4.2 Dec 3, 2013
0.4.1 Nov 28, 2013
0.4.0 Nov 11, 2013
0.3.2 Sep 23, 2013
0.3.1 Sep 8, 2013
0.3.0 Sep 4, 2013
0.2.1 Aug 20, 2013