Kite Data MapReduce Module

The Kite Data MapReduce module provides MapReduce support for working with Kite datasets.

License

License

Categories

Categories

Data
GroupId

GroupId

org.kitesdk
ArtifactId

ArtifactId

kite-data-mapreduce
Last Version

Last Version

1.1.0
Release Date

Release Date

Type

Type

jar
Description

Description

Kite Data MapReduce Module
The Kite Data MapReduce module provides MapReduce support for working with Kite datasets.

Download kite-data-mapreduce

How to add to project

<!-- https://jarcasting.com/artifacts/org.kitesdk/kite-data-mapreduce/ -->
<dependency>
    <groupId>org.kitesdk</groupId>
    <artifactId>kite-data-mapreduce</artifactId>
    <version>1.1.0</version>
</dependency>
// https://jarcasting.com/artifacts/org.kitesdk/kite-data-mapreduce/
implementation 'org.kitesdk:kite-data-mapreduce:1.1.0'
// https://jarcasting.com/artifacts/org.kitesdk/kite-data-mapreduce/
implementation ("org.kitesdk:kite-data-mapreduce:1.1.0")
'org.kitesdk:kite-data-mapreduce:jar:1.1.0'
<dependency org="org.kitesdk" name="kite-data-mapreduce" rev="1.1.0">
  <artifact name="kite-data-mapreduce" type="jar" />
</dependency>
@Grapes(
@Grab(group='org.kitesdk', module='kite-data-mapreduce', version='1.1.0')
)
libraryDependencies += "org.kitesdk" % "kite-data-mapreduce" % "1.1.0"
[org.kitesdk/kite-data-mapreduce "1.1.0"]

Dependencies

compile (5)

Group / Artifact Type Version
org.kitesdk : kite-data-core jar 1.1.0
org.kitesdk : kite-data-hive Optional jar 1.1.0
org.kitesdk : kite-data-hbase Optional jar 1.1.0
org.kitesdk : kite-hadoop-compatibility jar 1.1.0
org.apache.avro : avro jar 1.7.5

provided (4)

Group / Artifact Type Version
org.kitesdk : kite-hadoop-dependencies pom 1.1.0
org.kitesdk : kite-hbase-dependencies pom 1.1.0
com.google.code.findbugs : jsr305 Optional jar 2.0.1
com.google.code.findbugs : annotations jar 2.0.1

test (5)

Group / Artifact Type Version
junit : junit jar 4.10
org.kitesdk : kite-data-core test-jar 1.1.0
org.kitesdk : kite-data-hbase test-jar 1.1.0
org.kitesdk : kite-hadoop-test-dependencies pom 1.1.0
org.kitesdk : kite-hbase-test-dependencies pom 1.1.0

Project Modules

There are no modules declared in this project.

Kite Build Status Gitter chat

Kite is a set of libraries, tools, examples, and documentation focused on making it easier to build systems on top of the Hadoop ecosystem.

The goals of Kite are:

  • Codify expert patterns and practices for building data-oriented systems and applications.
  • Let developers focus on business logic, not plumbing or infrastructure.
  • Provide smart defaults for platform choices.
  • Support piecemeal adoption via loosely-coupled modules.

Eric Sammer recorded a webinar in which he talks about the goals of the project, which was then called CDK (the Cloudera Development Kit).

This project is organized into modules. Modules may be independent or have dependencies on other modules within Kite. When possible, dependencies on external projects are minimized.

Modules

The following modules currently exist.

Kite Data

The data module provides logical abstractions on top of storage subsystems (e.g. HDFS) that let users think and operate in terms of records, datasets, and dataset repositories. If you're looking to read or write records directly to/from a storage system, the data module is for you.

Kite Maven Plugin

The Kite Maven Plugin provides Maven goals for packaging, deploying, and running distributed applications.

Kite Morphlines

The Morphlines module reduces the time and skills necessary to build and change Hadoop ETL stream processing applications that extract, transform and load data into Apache Solr, Enterprise Data Warehouses, HDFS, HBase or Analytic Online Dashboards.

Kite Tools

The tools module provides command-line tools and APIs for performing common tasks with the Kite.

Examples

Example code demonstrating how to use Kite can be found in the separate GitHub repository at https://github.com/kite-sdk/kite-examples

License

Kite is provided under the Apache Software License 2.0. See the file LICENSE.txt for more information.

Building

To build using the default CDH dependencies use

mvn install

For Hadoop 2:

mvn install -Dhadoop.profile=2

For Hadoop 1:

mvn install -Dhadoop.profile=1

By default Java 7 is used. If you want to use Java 6, then add -DjavaVersion=1.6, -DjavaTargetVersion=1.6 e.g.

mvn install -DjavaVersion=1.6 -DjavaTargetVersion=1.6
org.kitesdk

Kite SDK Project

Versions

Version
1.1.0
1.0.0
0.18.0
0.17.1
0.17.0
0.16.0
0.15.0