kafka-load-testing-parent

A pom for deploying to maven central.

License	Apache License 2.0
GroupId	com.github.jcustenborder.kafka
ArtifactId	kafka-load-testing-parent
Last Version	0.0.1.2
Release Date	Dec 10, 2019
Type	pom
Description	kafka-load-testing-parent A pom for deploying to maven central.
Project URL	https://github.com/jcustenborder/kafka-load-testing
Source Code Management	https://github.com/jcustenborder/kafka-load-testing

Download kafka-load-testing-parent

Filename	Size
kafka-load-testing-parent-0.0.1.2.pom	8 KB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/com.github.jcustenborder.kafka/kafka-load-testing-parent/ -->
<dependency>
    <groupId>com.github.jcustenborder.kafka</groupId>
    <artifactId>kafka-load-testing-parent</artifactId>
    <version>0.0.1.2</version>
    <type>pom</type>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/com.github.jcustenborder.kafka/kafka-load-testing-parent/
implementation 'com.github.jcustenborder.kafka:kafka-load-testing-parent:0.0.1.2'

Gradle Kotlin

// https://jarcasting.com/artifacts/com.github.jcustenborder.kafka/kafka-load-testing-parent/
implementation ("com.github.jcustenborder.kafka:kafka-load-testing-parent:0.0.1.2")

Apache Buildr

'com.github.jcustenborder.kafka:kafka-load-testing-parent:pom:0.0.1.2'

Apache Ivy

<dependency org="com.github.jcustenborder.kafka" name="kafka-load-testing-parent" rev="0.0.1.2">
  <artifact name="kafka-load-testing-parent" type="pom" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='com.github.jcustenborder.kafka', module='kafka-load-testing-parent', version='0.0.1.2')
)

Scala SBT

libraryDependencies += "com.github.jcustenborder.kafka" % "kafka-load-testing-parent" % "0.0.1.2"

Leiningen

[com.github.jcustenborder.kafka/kafka-load-testing-parent "0.0.1.2"]

Dependencies

compile (5)

Group / Artifact	Type	Version
org.apache.kafka : kafka-clients	jar	2.2.1
io.confluent » kafka-avro-serializer	jar	5.3.1
org.slf4j : slf4j-api	jar	1.7.21
ch.qos.logback : logback-classic	jar	1.1.8
com.google.guava : guava	jar	23.0

test (3)

Group / Artifact	Type	Version
org.junit.jupiter : junit-jupiter-engine	jar	5.0.0
org.junit.jupiter : junit-jupiter-api	jar	5.0.0
org.mockito : mockito-core	jar	1.10.19

Project Modules

• stackoverflow-datagenerator
• common
• load-testing-producer

Introduction

The purpose of this project is to create a data set that can be reliably used to tune a Kafka cluster.

Stack Exchange dataset(s)

The Stack Exchange dataset(s) are a complete dump of the data that for sites like Stack Overflow. This dataset is large and each row can be significantly different than the previous row. This is great for testing different settings like compression.

Generating data sets

Download data from the here.

java -jar stackoverflow-datagenerator-0.0.1-SNAPSHOT.jar --input stackoverflow.com-Votes.7z --output data/

This will read from the 7z file that was downloaded and generate avro data files that will be used for testing in the output directory.

Load testing

--producer-config foo.properties --create-topic 1.avro 2.avro 3.avro

Versions

Version
0.0.1.2 Dec 10, 2019