JarCasting
JarCasting JarCasting

com.groupon.dse:mezzanine

A library built on Spark Streaming used to consume data from Kafka and store it into Hadoop.

License

License
GroupId

GroupId

com.groupon.dse
ArtifactId

ArtifactId

mezzanine
Last Version

Last Version

1.0
Release Date

Release Date
Type

Type

jar
Description

Description

com.groupon.dse:mezzanine
A library built on Spark Streaming used to consume data from Kafka and store it into Hadoop.
Project URL

Project URL

https://github.com/groupon/mezzanine
Source Code Management

Source Code Management

https://github.com/groupon/mezzanine

Download mezzanine

Filename Size
mezzanine-1.0.pom
mezzanine-1.0.jar 102 KB
mezzanine-1.0-tests.jar 123 KB
mezzanine-1.0-test-sources.jar 26 KB
mezzanine-1.0-sources.jar 39 KB
mezzanine-1.0-javadoc.jar 467 KB
Browse

How to add to project

<!-- https://jarcasting.com/artifacts/com.groupon.dse/mezzanine/ -->
<dependency>
    <groupId>com.groupon.dse</groupId>
    <artifactId>mezzanine</artifactId>
    <version>1.0</version>
</dependency>
// https://jarcasting.com/artifacts/com.groupon.dse/mezzanine/
implementation 'com.groupon.dse:mezzanine:1.0'
// https://jarcasting.com/artifacts/com.groupon.dse/mezzanine/
implementation ("com.groupon.dse:mezzanine:1.0")
'com.groupon.dse:mezzanine:jar:1.0'
<dependency org="com.groupon.dse" name="mezzanine" rev="1.0">
  <artifact name="mezzanine" type="jar" />
</dependency>
@Grapes(
@Grab(group='com.groupon.dse', module='mezzanine', version='1.0')
)
libraryDependencies += "com.groupon.dse" % "mezzanine" % "1.0"
[com.groupon.dse/mezzanine "1.0"]

Dependencies

compile (4)

Group / Artifact Type Version
com.groupon.dse : baryon jar 1.0
com.groupon.dse : spark-metrics jar 1.0
org.scala-lang : scala-library jar 2.10.4
org.slf4j : slf4j-api jar 1.7.10

provided (5)

Group / Artifact Type Version
log4j : log4j jar 1.2.17
org.apache.spark : spark-core_2.10 jar 1.5.2
org.apache.spark : spark-streaming_2.10 jar 1.5.2
org.apache.hadoop : hadoop-common jar 2.6.0
org.apache.hadoop : hadoop-mapreduce-client-core jar 2.6.0

test (1)

Group / Artifact Type Version
org.scalatest : scalatest_2.10 jar 2.2.4

Project Modules

There are no modules declared in this project.

Mezzanine

Mezzanine is a library built on Spark Streaming used to consume data from Kafka and store it into Hadoop.

This library was built to replace the batch-based model of Kafka consumption, where jobs would be launched periodically to consume and persist large amounts of data at a time. Mezzanine contains logic for transforming, partitioning, and compacting the consumed Kafka data to persist them in HDFS. It was built with Baryon to handle the Kafka consumption, but Mezzanine can still be used as library with other methods for consuming from Kafka.

See the wiki for a full guide to using Mezzanine.

Quick Start

To use this library, add the dependency to mezzanine in your project:

<dependency>
    <groupId>com.groupon.dse</groupId>
    <artifactId>mezzanine</artifactId>
    <version>1.0</version>
</dependency>

Include Baryon to use the MezzaninePlugin that comes with Mezzanine:

<dependency>
    <groupId>com.groupon.dse</groupId>
    <artifactId>baryon</artifactId>
    <version>1.0</version>
</dependency>
com.groupon.dse

Groupon

Versions

Version
1.0