kafka-utils

kafka utils

License	MIT License
GroupId	sc.ala
ArtifactId	kafka-utils_2.11
Last Version	0.2.0
Release Date	Dec 25, 2015
Type	jar
Description	kafka-utils kafka utils
Project URL	https://github.com/maiha/kafka-utils
Project Organization	sc.ala
Source Code Management	https://github.com/maiha/kafka-utils

Download kafka-utils_2.11

Filename	Size
kafka-utils_2.11-0.2.0.pom
kafka-utils_2.11-0.2.0.jar	89 KB
kafka-utils_2.11-0.2.0-sources.jar	6 KB
kafka-utils_2.11-0.2.0-javadoc.jar	379 KB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/sc.ala/kafka-utils_2.11/ -->
<dependency>
    <groupId>sc.ala</groupId>
    <artifactId>kafka-utils_2.11</artifactId>
    <version>0.2.0</version>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/sc.ala/kafka-utils_2.11/
implementation 'sc.ala:kafka-utils_2.11:0.2.0'

Gradle Kotlin

// https://jarcasting.com/artifacts/sc.ala/kafka-utils_2.11/
implementation ("sc.ala:kafka-utils_2.11:0.2.0")

Apache Buildr

'sc.ala:kafka-utils_2.11:jar:0.2.0'

Apache Ivy

<dependency org="sc.ala" name="kafka-utils_2.11" rev="0.2.0">
  <artifact name="kafka-utils_2.11" type="jar" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='sc.ala', module='kafka-utils_2.11', version='0.2.0')
)

Scala SBT

libraryDependencies += "sc.ala" % "kafka-utils_2.11" % "0.2.0"

Leiningen

[sc.ala/kafka-utils_2.11 "0.2.0"]

Dependencies

compile (5)

Group / Artifact	Type	Version
org.scala-lang : scala-library	jar	2.11.7
org.apache.kafka : kafka_2.11	jar	0.9.0.0
org.apache.kafka : kafka-clients	jar	0.9.0.0
sc.ala : rubyist_2.11	jar	0.2.6
pl.project13.scala : rainbow_2.11	jar	0.2

test (1)

Group / Artifact	Type	Version
org.scalatest : scalatest_2.11	jar	2.2.4

Project Modules

There are no modules declared in this project.

KafkaUtils

Simple Kafka Utils in Scala

Features

• simple api
  • see sc.ala.kafka.utils.Api

Usage

prepare

import sc.ala.kafka.utils._
val utils = KafkaUtils("localhost:2181")  // set zkConnect

1 hop api (just type one word)

get broker list

utils.brokers
// Seq[kafka.cluster.Broker] = ArrayBuffer(id:1,host:ubuntu,port:9092)

get topic names

utils.topics
// Seq[String] = ArrayBuffer(topic1, test)

about topic

create topic

utils.create("topic1", 1, 3)

leader broker ids for the topic

utils.leaders("topic1")
// Map[Int,Option[Int]] = Map(2 -> Some(1), 1 -> Some(1), 0 -> Some(1))

partitions for the topic

utils.partitions("topic1")
// Seq[Int] = ArrayBuffer(2, 1, 0)

delete topic

utils.delete("topic1")

count messages

utils.count("topic1")
// Long = 5

utils.counts("topic1")
// Map(2 -> 0, 1 -> 5, 0 -> 0)

list topics and counts

utils.topics.sorted.foreach{ t => println(s"${utils.count(t)}\t$t") }
// 1       t1
// 1534339 t2
// 0       t3

offset

utils.offset("topic1")
// Long = 5

utils.offsets("topic1")
// Map[Int,Long] = Map(2 -> 0, 1 -> 0, 0 -> 3)

teardown

utils.close

TODO

• write tests
• consumers

Tested

• kafka-0.9.0
• kafka-0.8.2

Versions

Version
0.2.0 Dec 25, 2015
0.1.1 Jul 6, 2015
0.1.0 Jul 5, 2015