JarCastingWeb Crawling
webmagic-core
us.codecraft : webmagic-coreA crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.
Last Version: 0.7.5
Release Date:webmagic-extension
us.codecraft : webmagic-extensionA crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.
Last Version: 0.7.5
Release Date:WebMagic :: Spring Boot :: Starter
in.hocg.boot : webmagic-spring-boot-starterThe Apache Software Foundation provides support for the Apache community of open-source software projects. The Apache projects are characterized by a collaborative, consensus based development process, an open and pragmatic software license, and a desire to create high quality software that leads the way in its field. We consider ourselves not simply a group of projects sharing a server, but rather a community of developers and users.
Last Version: 1.0.45
Release Date:WebMagic :: Spring Boot :: AutoConfigure
in.hocg.boot : webmagic-spring-boot-autoconfigureThe Apache Software Foundation provides support for the Apache community of open-source software projects. The Apache projects are characterized by a collaborative, consensus based development process, an open and pragmatic software license, and a desire to create high quality software that leads the way in its field. We consider ourselves not simply a group of projects sharing a server, but rather a community of developers and users.
Last Version: 1.0.45
Release Date:Mybatis Plus :: Extensions :: WebMagic :: Spring Boot :: Starter
in.hocg.boot : mybatis-plus-extensions-webmagic-spring-boot-starterThe Apache Software Foundation provides support for the Apache community of open-source software projects. The Apache projects are characterized by a collaborative, consensus based development process, an open and pragmatic software license, and a desire to create high quality software that leads the way in its field. We consider ourselves not simply a group of projects sharing a server, but rather a community of developers and users.
Last Version: 1.0.45
Release Date:Mybatis Plus :: Extensions :: WebMagic
in.hocg.boot : mybatis-plus-extensions-webmagic-autoconfigureThe Apache Software Foundation provides support for the Apache community of open-source software projects. The Apache projects are characterized by a collaborative, consensus based development process, an open and pragmatic software license, and a desire to create high quality software that leads the way in its field. We consider ourselves not simply a group of projects sharing a server, but rather a community of developers and users.
Last Version: 1.0.45
Release Date:webmagic-selenium
us.codecraft : webmagic-seleniumA crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.
Last Version: 0.7.5
Release Date:
Last Version: 2.4
Release Date:Last Version: 4.4.0
Release Date:webmagic-core
com.github.ancienter : webmagic-coreA crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.
Last Version: v2020.6.17
Release Date:de.hs-heilbronn.mi:crawler4j-commons
de.hs-heilbronn.mi : crawler4j-commonsOpen Source Web Crawler for Java
Last Version: 4.9.1
Release Date:de.hs-heilbronn.mi:crawler4j-core
de.hs-heilbronn.mi : crawler4j-coreOpen Source Web Crawler for Java
Last Version: 4.9.1
Release Date:de.hs-heilbronn.mi:crawler4j-with-sleepycat
de.hs-heilbronn.mi : crawler4j-with-sleepycatOpen Source Web Crawler for Java
Last Version: 4.9.1
Release Date:webmagic-extension
com.github.ancienter : webmagic-extensionA crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.
Last Version: v2020.6.17
Release Date:de.hs-heilbronn.mi:crawler4j-frontier-urlfrontier
de.hs-heilbronn.mi : crawler4j-frontier-urlfrontierOpen Source Web Crawler for Java
Last Version: 4.9.1
Release Date:de.hs-heilbronn.mi:crawler4j-with-hsqldb
de.hs-heilbronn.mi : crawler4j-with-hsqldbOpen Source Web Crawler for Java
Last Version: 4.9.1
Release Date:de.hs-heilbronn.mi:crawler4j-frontier-sleepycat
de.hs-heilbronn.mi : crawler4j-frontier-sleepycatOpen Source Web Crawler for Java
Last Version: 4.9.1
Release Date:crawler4j
com.goikosoft.crawler4j : crawler4jcrawler4j: Open Source Web Crawler for Java. Modified by Dario Goikoetxea to add POST capabilities
Last Version: 4.5.11
Release Date:de.hs-heilbronn.mi:crawler4j-frontier-hsqldb
de.hs-heilbronn.mi : crawler4j-frontier-hsqldbOpen Source Web Crawler for Java
Last Version: 4.9.1
Release Date:de.hs-heilbronn.mi:crawler4j-with-urlfrontier
de.hs-heilbronn.mi : crawler4j-with-urlfrontierOpen Source Web Crawler for Java
Last Version: 4.9.1
Release Date:webmagic-saxon
us.codecraft : webmagic-saxonA crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.
Last Version: 0.7.5
Release Date:webmagic-samples
us.codecraft : webmagic-samplesA crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.
Last Version: 0.7.5
Release Date:webmagic-scripts
us.codecraft : webmagic-scriptsA crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.
Last Version: 0.7.5
Release Date:webmagic-spring-boot-starter
com.github.romewing : webmagic-spring-boot-starterWebMagic spring boot starter
Last Version: 1.0
Release Date:webmagic-spring-boot-autoconfigure
com.github.romewing : webmagic-spring-boot-autoconfigureSpring Boot Support for Webmagic
Last Version: 1.0
Release Date:de.hs-heilbronn.mi:crawler4j-parent
de.hs-heilbronn.mi : crawler4j-parentOpen Source Web Crawler for Java
Last Version: 4.9.1
Release Date:edu.uci.ics:crawler4j-examples-base
edu.uci.ics : crawler4j-examples-baseOpen Source Web Crawler for Java - base examples
Last Version: 4.4.0
Release Date:Last Version: 4.4.0
Release Date:de.hs-heilbronn.mi:crawler4j-examples-base
de.hs-heilbronn.mi : crawler4j-examples-baseOpen Source Web Crawler for Java
Last Version: 4.9.1
Release Date:edu.uci.ics:crawler4j-examples-postgres
edu.uci.ics : crawler4j-examples-postgresOpen Source Web Crawler for Java - example with jdbc and Postgres
Last Version: 4.4.0
Release Date:de.hs-heilbronn.mi:crawler4j-frontier
de.hs-heilbronn.mi : crawler4j-frontierOpen Source Web Crawler for Java
Last Version: 4.9.1
Release Date:de.hs-heilbronn.mi:crawler4j-boms
de.hs-heilbronn.mi : crawler4j-bomsOpen Source Web Crawler for Java
Last Version: 4.9.1
Release Date:de.hs-heilbronn.mi:crawler4j-examples-postgres
de.hs-heilbronn.mi : crawler4j-examples-postgresOpen Source Web Crawler for Java
Last Version: 4.9.1
Release Date:de.hs-heilbronn.mi:crawler4j-examples
de.hs-heilbronn.mi : crawler4j-examplesOpen Source Web Crawler for Java
Last Version: 4.9.1
Release Date:
Last Version: 3.3.2
Release Date:
storm-crawler-urlfrontier
com.digitalpebble.stormcrawler : storm-crawler-urlfrontierURL Frontier resources for StormCrawler
Last Version: 2.4
Release Date:
storm-crawler-sql
com.digitalpebble.stormcrawler : storm-crawler-sqlSQL-based resources for StormCrawler
Last Version: 2.4
Release Date:
storm-crawler-solr
com.digitalpebble.stormcrawler : storm-crawler-solrSolr resources for StormCrawler
Last Version: 2.4
Release Date:
storm-crawler-external
com.digitalpebble.stormcrawler : storm-crawler-externalA collection of resources for building low-latency, scalable web crawlers on Apache Storm.
Last Version: 2.4
Release Date:
storm-crawler-langid
com.digitalpebble.stormcrawler : storm-crawler-langidLanguage Identification for StormCrawler
Last Version: 2.4
Release Date:
storm-crawler
com.digitalpebble.stormcrawler : storm-crawlerA collection of resources for building low-latency, scalable web crawlers on Apache Storm.
Last Version: 2.4
Release Date:storm-crawler-elasticsearch-archetype
com.digitalpebble.stormcrawler : storm-crawler-elasticsearch-archetypeA collection of resources for building low-latency, scalable web crawlers on Apache Storm.
Last Version: 2.4
Release Date:
storm-crawler-elasticsearch
com.digitalpebble.stormcrawler : storm-crawler-elasticsearchElasticsearch resources for StormCrawler
Last Version: 2.4
Release Date:
storm-crawler-tika
com.digitalpebble.stormcrawler : storm-crawler-tikaTika-based parser bolt for StormCrawler
Last Version: 2.4
Release Date:
storm-crawler-warc
com.digitalpebble.stormcrawler : storm-crawler-warcWARC resources for StormCrawler
Last Version: 2.4
Release Date:
storm-crawler-archetype
com.digitalpebble.stormcrawler : storm-crawler-archetypeA collection of resources for building low-latency, scalable web crawlers on Apache Storm.
Last Version: 2.4
Release Date:
Last Version: 2.4
Release Date:webmagic-spring-boot-samples
com.github.romewing : webmagic-spring-boot-samplesSpring Boot Support for Webmagic
Last Version: 1.0
Release Date:webmagic-saxon
com.github.ancienter : webmagic-saxonA crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.
Last Version: v2020.6.17
Release Date:- 1