Apache Crunch for Kafka

Apache Crunch is a Java library for writing, testing, and running Hadoop MapReduce pipelines, based on Google's FlumeJava. Its goal is to make pipelines that are composed of many user-defined functions simple to write, easy to test, and efficient to run.

License

License

GroupId

GroupId

org.apache.crunch
ArtifactId

ArtifactId

crunch-kafka
Last Version

Last Version

1.0.0
Release Date

Release Date

Type

Type

jar
Description

Description

Apache Crunch for Kafka
Apache Crunch is a Java library for writing, testing, and running Hadoop MapReduce pipelines, based on Google's FlumeJava. Its goal is to make pipelines that are composed of many user-defined functions simple to write, easy to test, and efficient to run.
Project Organization

Project Organization

The Apache Software Foundation
Source Code Management

Source Code Management

https://git-wip-us.apache.org/repos/asf?p=crunch.git/crunch-kafka

Download crunch-kafka

How to add to project

<!-- https://jarcasting.com/artifacts/org.apache.crunch/crunch-kafka/ -->
<dependency>
    <groupId>org.apache.crunch</groupId>
    <artifactId>crunch-kafka</artifactId>
    <version>1.0.0</version>
</dependency>
// https://jarcasting.com/artifacts/org.apache.crunch/crunch-kafka/
implementation 'org.apache.crunch:crunch-kafka:1.0.0'
// https://jarcasting.com/artifacts/org.apache.crunch/crunch-kafka/
implementation ("org.apache.crunch:crunch-kafka:1.0.0")
'org.apache.crunch:crunch-kafka:jar:1.0.0'
<dependency org="org.apache.crunch" name="crunch-kafka" rev="1.0.0">
  <artifact name="crunch-kafka" type="jar" />
</dependency>
@Grapes(
@Grab(group='org.apache.crunch', module='crunch-kafka', version='1.0.0')
)
libraryDependencies += "org.apache.crunch" % "crunch-kafka" % "1.0.0"
[org.apache.crunch/crunch-kafka "1.0.0"]

Dependencies

compile (9)

Group / Artifact Type Version
org.apache.crunch : crunch-core jar 1.0.0
org.apache.kafka : kafka-clients jar 0.10.2.1
org.apache.kafka : kafka_2.11 jar 0.10.2.1
org.scala-lang : scala-library jar 2.11.8
org.apache.hadoop : hadoop-client jar 2.7.1
com.fasterxml.jackson.core : jackson-databind Optional jar 2.6.1
com.fasterxml.jackson.core : jackson-annotations Optional jar 2.6.1
joda-time : joda-time Optional jar 2.8.1
org.slf4j : slf4j-api jar 1.6.1

test (4)

Group / Artifact Type Version
org.slf4j : slf4j-log4j12 jar 1.6.1
org.apache.crunch : crunch-test jar 1.0.0
junit : junit jar 4.10
org.hamcrest : hamcrest-all jar 1.1

Project Modules

There are no modules declared in this project.

Versions

Version
1.0.0
0.15.0