Apache Crunch for Spark

Apache Crunch is a Java library for writing, testing, and running Hadoop MapReduce pipelines, based on Google's FlumeJava. Its goal is to make pipelines that are composed of many user-defined functions simple to write, easy to test, and efficient to run.

License	Apache License, Version 2.0
GroupId	org.apache.crunch
ArtifactId	crunch-spark
Last Version	1.0.0
Release Date	Oct 9, 2019
Type	jar
Description	Apache Crunch for Spark Apache Crunch is a Java library for writing, testing, and running Hadoop MapReduce pipelines, based on Google's FlumeJava. Its goal is to make pipelines that are composed of many user-defined functions simple to write, easy to test, and efficient to run.
Project Organization	The Apache Software Foundation
Source Code Management	https://git-wip-us.apache.org/repos/asf?p=crunch.git/crunch-spark

Download crunch-spark

Filename	Size
crunch-spark-1.0.0.pom
crunch-spark-1.0.0.jar	122 KB
crunch-spark-1.0.0-sources.jar	77 KB
crunch-spark-1.0.0-javadoc.jar	328 KB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/org.apache.crunch/crunch-spark/ -->
<dependency>
    <groupId>org.apache.crunch</groupId>
    <artifactId>crunch-spark</artifactId>
    <version>1.0.0</version>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/org.apache.crunch/crunch-spark/
implementation 'org.apache.crunch:crunch-spark:1.0.0'

Gradle Kotlin

// https://jarcasting.com/artifacts/org.apache.crunch/crunch-spark/
implementation ("org.apache.crunch:crunch-spark:1.0.0")

Apache Buildr

'org.apache.crunch:crunch-spark:jar:1.0.0'

Apache Ivy

<dependency org="org.apache.crunch" name="crunch-spark" rev="1.0.0">
  <artifact name="crunch-spark" type="jar" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='org.apache.crunch', module='crunch-spark', version='1.0.0')
)

Scala SBT

libraryDependencies += "org.apache.crunch" % "crunch-spark" % "1.0.0"

Leiningen

[org.apache.crunch/crunch-spark "1.0.0"]

Dependencies

compile (5)

Group / Artifact	Type	Version
org.scala-lang : scala-library	jar	2.11.8
com.google.guava : guava	jar	14.0.1
org.apache.crunch : crunch-core	jar	1.0.0
org.apache.crunch : crunch-scrunch	jar	1.0.0
org.slf4j : slf4j-api	jar	1.6.1

provided (5)

Group / Artifact	Type	Version
org.apache.hadoop : hadoop-client	jar	2.7.1
org.apache.spark : spark-core_2.11	jar	2.0.0
com.google.protobuf : protobuf-java	jar	2.5.0
org.apache.hbase : hbase-testing-util	jar	2.0.1
org.apache.hbase : hbase-mapreduce	jar	2.0.1

test (6)

Group / Artifact	Type	Version
org.slf4j : slf4j-log4j12	jar	1.6.1
org.apache.crunch : crunch-test	jar	1.0.0
org.apache.crunch : crunch-hbase	jar	1.0.0
junit : junit	jar	4.10
org.scalatest : scalatest_2.11	jar	2.2.4
org.hamcrest : hamcrest-all	jar	1.1

Project Modules

There are no modules declared in this project.

Versions

Version
1.0.0 Oct 9, 2019
0.15.0 Feb 17, 2017
0.14.0 Apr 24, 2016
0.13.0 Jul 30, 2015
0.12.0-hadoop2 May 14, 2015
0.12.0 May 9, 2015
0.11.0-hadoop2 Aug 28, 2014
0.11.0 Aug 28, 2014
0.10.0-hadoop2 Jun 3, 2014
0.10.0 Jun 3, 2014
0.9.0-hadoop2 Dec 13, 2013
0.9.0 Dec 12, 2013
0.8.4-hadoop2 Sep 3, 2014
0.8.4 Sep 5, 2014
0.8.3-hadoop2 Jun 3, 2014
0.8.3 Jun 3, 2014
0.8.2-hadoop2 Dec 12, 2013
0.8.2 Dec 12, 2013