com.github.jcustenborder.kafka:kafka-loadtesting-common

A pom for deploying to maven central.

License	Apache License 2.0
GroupId	com.github.jcustenborder.kafka
ArtifactId	kafka-loadtesting-common
Last Version	0.0.1.2
Release Date	Dec 10, 2019
Type	jar
Description	A pom for deploying to maven central.

Download kafka-loadtesting-common

Filename	Size
kafka-loadtesting-common-0.0.1.2.pom
kafka-loadtesting-common-0.0.1.2.jar	142 KB
kafka-loadtesting-common-0.0.1.2-sources.jar	77 KB
kafka-loadtesting-common-0.0.1.2-javadoc.jar	379 KB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/com.github.jcustenborder.kafka/kafka-loadtesting-common/ -->
<dependency>
    <groupId>com.github.jcustenborder.kafka</groupId>
    <artifactId>kafka-loadtesting-common</artifactId>
    <version>0.0.1.2</version>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/com.github.jcustenborder.kafka/kafka-loadtesting-common/
implementation 'com.github.jcustenborder.kafka:kafka-loadtesting-common:0.0.1.2'

Gradle Kotlin

// https://jarcasting.com/artifacts/com.github.jcustenborder.kafka/kafka-loadtesting-common/
implementation ("com.github.jcustenborder.kafka:kafka-loadtesting-common:0.0.1.2")

Apache Buildr

'com.github.jcustenborder.kafka:kafka-loadtesting-common:jar:0.0.1.2'

Apache Ivy

<dependency org="com.github.jcustenborder.kafka" name="kafka-loadtesting-common" rev="0.0.1.2">
  <artifact name="kafka-loadtesting-common" type="jar" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='com.github.jcustenborder.kafka', module='kafka-loadtesting-common', version='0.0.1.2')
)

Scala SBT

libraryDependencies += "com.github.jcustenborder.kafka" % "kafka-loadtesting-common" % "0.0.1.2"

Leiningen

[com.github.jcustenborder.kafka/kafka-loadtesting-common "0.0.1.2"]

Dependencies

compile (6)

Group / Artifact	Type	Version
org.apache.avro : avro	jar	1.9.1
org.apache.kafka : kafka-clients	jar	2.2.1
io.confluent » kafka-avro-serializer	jar	5.3.1
org.slf4j : slf4j-api	jar	1.7.21
ch.qos.logback : logback-classic	jar	1.1.8
com.google.guava : guava	jar	23.0

test (3)

Group / Artifact	Type	Version
org.junit.jupiter : junit-jupiter-engine	jar	5.0.0
org.junit.jupiter : junit-jupiter-api	jar	5.0.0
org.mockito : mockito-core	jar	1.10.19

Project Modules

There are no modules declared in this project.

Introduction

The purpose of this project is to create a data set that can be reliably used to tune a Kafka cluster.

Stack Exchange dataset(s)

The Stack Exchange dataset(s) are a complete dump of the data that for sites like Stack Overflow. This dataset is large and each row can be significantly different than the previous row. This is great for testing different settings like compression.

Generating data sets

Download data from the here.

java -jar stackoverflow-datagenerator-0.0.1-SNAPSHOT.jar --input stackoverflow.com-Votes.7z --output data/

This will read from the 7z file that was downloaded and generate avro data files that will be used for testing in the output directory.

Load testing

--producer-config foo.properties --create-topic 1.avro 2.avro 3.avro

Versions

Version
0.0.1.2 Dec 10, 2019