Apache Spark utilities

Pretty handy Apache Spark thin wrappers.

License	MIT License
GroupId	com.github.cbismuth
ArtifactId	spark-utils
Last Version	1.2.0
Release Date	Mar 27, 2017
Type	jar
Description	Apache Spark utilities Pretty handy Apache Spark thin wrappers.
Project URL	https://github.com/cbismuth/spark-utils
Source Code Management	https://github.com/cbismuth/spark-utils

Download spark-utils

Filename	Size
spark-utils-1.2.0.pom
spark-utils-1.2.0.jar	12 KB
spark-utils-1.2.0-sources.jar	11 KB
spark-utils-1.2.0-javadoc.jar	67 KB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/com.github.cbismuth/spark-utils/ -->
<dependency>
    <groupId>com.github.cbismuth</groupId>
    <artifactId>spark-utils</artifactId>
    <version>1.2.0</version>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/com.github.cbismuth/spark-utils/
implementation 'com.github.cbismuth:spark-utils:1.2.0'

Gradle Kotlin

// https://jarcasting.com/artifacts/com.github.cbismuth/spark-utils/
implementation ("com.github.cbismuth:spark-utils:1.2.0")

Apache Buildr

'com.github.cbismuth:spark-utils:jar:1.2.0'

Apache Ivy

<dependency org="com.github.cbismuth" name="spark-utils" rev="1.2.0">
  <artifact name="spark-utils" type="jar" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='com.github.cbismuth', module='spark-utils', version='1.2.0')
)

Scala SBT

libraryDependencies += "com.github.cbismuth" % "spark-utils" % "1.2.0"

Leiningen

[com.github.cbismuth/spark-utils "1.2.0"]

Dependencies

compile (1)

Group / Artifact	Type	Version
org.apache.hadoop : hadoop-minicluster	jar	2.8.0

provided (1)

Group / Artifact	Type	Version
org.apache.spark : spark-core_2.11	jar	2.1.0

test (3)

Group / Artifact	Type	Version
junit : junit	jar	4.12
org.mockito : mockito-core	jar	2.7.19
org.assertj : assertj-core	jar	3.6.2

Project Modules

There are no modules declared in this project.

Spark Utils

Description

Apache Spark lightweight utilities.

• Fluent partition mapping API (here)
• Hadoop MiniDFSCluster setup with Spark (here)
• AutoCloseableBroadcast (here)

Issues

Here is how issues are triaged:

• Bug: identifies an unexpected result or application behaviour.
• Feature: adds an new end-user feature.
• Enhancement: improves the way the application behaves but produces the same result.
• Spike: improves implementation design but does not change application behaviour and produces the same result.

Credits

Written by Christophe Bismuth, licensed under the The MIT License (MIT).

Versions

Version
1.2.0 Mar 27, 2017
1.1.1 Oct 10, 2016
1.1.0 Oct 7, 2016
1.0.0 Oct 5, 2016
1.0.0-M1 Oct 4, 2016