Scala Kafka

Quick up and running using Scala for Apache Kafka

License	The Apache Software License, Version 2.0
Categories	Scala Languages
GroupId	ly.stealth
ArtifactId	scala-kafka
Last Version	0.1.0.0
Release Date	Sep 22, 2014
Type	jar
Description	Scala Kafka Quick up and running using Scala for Apache Kafka
Project URL	http://github.com/stealthly/scala-kafka
Source Code Management	http://github.com/stealthly/scala-kafka

Download scala-kafka

Filename	Size
scala-kafka-0.1.0.0.pom
scala-kafka-0.1.0.0.jar	25 KB
scala-kafka-0.1.0.0-sources.jar	6 KB
scala-kafka-0.1.0.0-javadoc.jar	261 bytes

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/ly.stealth/scala-kafka/ -->
<dependency>
    <groupId>ly.stealth</groupId>
    <artifactId>scala-kafka</artifactId>
    <version>0.1.0.0</version>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/ly.stealth/scala-kafka/
implementation 'ly.stealth:scala-kafka:0.1.0.0'

Gradle Kotlin

// https://jarcasting.com/artifacts/ly.stealth/scala-kafka/
implementation ("ly.stealth:scala-kafka:0.1.0.0")

Apache Buildr

'ly.stealth:scala-kafka:jar:0.1.0.0'

Apache Ivy

<dependency org="ly.stealth" name="scala-kafka" rev="0.1.0.0">
  <artifact name="scala-kafka" type="jar" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='ly.stealth', module='scala-kafka', version='0.1.0.0')
)

Scala SBT

libraryDependencies += "ly.stealth" % "scala-kafka" % "0.1.0.0"

Leiningen

[ly.stealth/scala-kafka "0.1.0.0"]

Dependencies

compile (13)

Group / Artifact	Type	Version
org.scala-lang : scala-library	jar	$scalaVersion
joda-time : joda-time	jar	2.3
log4j : log4j	jar	1.2.17
com.yammer.metrics : metrics-core	jar	2.2.0
nl.grons : metrics-scala_2.9.2	jar	3.0.3
com.typesafe.akka : akka-actor_2.10	jar	2.3.1
org.apache.kafka : kafka_2.10	jar	0.8.1.1
org.apache.thrift : libthrift	jar	0.9.1
com.101tec : zkclient	jar	0.3
com.github.scopt : scopt_2.9.2	jar	3.1.0
org.apache.avro : avro	jar	1.7.5
org.joda : joda-convert	jar	1.5
net.sf.jopt-simple : jopt-simple	jar	4.5

test (1)

Group / Artifact	Type	Version
org.specs2 : specs2_2.10	jar	2.2.2

Project Modules

There are no modules declared in this project.

scala-kafka

Quick up and running using Scala for Apache Kafka

Use Vagrant to get up and running.

1. Install Vagrant http://www.vagrantup.com/
2. Install Virtual Box https://www.virtualbox.org/

In the main kafka folder

1. vagrant up
2. ./gradlew test

once this is done

• Zookeeper will be running 192.168.86.5
• Broker 1 on 192.168.86.10
• All the tests in src/test/scala/* should pass

If you want you can login to the machines using vagrant ssh but you don't need to.

You can access the brokers and zookeeper by their IP from your local without having to go into vm.

e.g.

bin/kafka-console-producer.sh --broker-list 192.168.86.10:9092 --topic

bin/kafka-console-consumer.sh --zookeeper 192.168.86.5:2181 --topic --from-beginning

scala-go-kafka

Scala-kafka and Go-kafka working together using Apache Avro and Schema Registry

Install Docker https://docs.docker.com/installation/#installation

In the main scala-kafka folder

1. ./gradlew scalago jar
2. ./start-scala-go.sh
3. ./stop-scala-go.sh

Big Data Open Source Security

Versions

Version
0.1.0.0 Sep 22, 2014