JarCasting
JarCasting JarCasting

kstreams-kcql

Small utility lib for Kafka Streams to help with simple payload transformations

License

License
Categories

Categories

Data
GroupId

GroupId

com.datamountaineer
ArtifactId

ArtifactId

kstreams-kcql
Last Version

Last Version

0.1
Release Date

Release Date
Type

Type

jar
Description

Description

kstreams-kcql
Small utility lib for Kafka Streams to help with simple payload transformations
Project URL

Project URL

https://github.com/datamountaineer/kafka-connect-common
Source Code Management

Source Code Management

https://github.com/datamountaineer/kafka-connect-common.git

Download kstreams-kcql

Filename Size
kstreams-kcql-0.1.pom
kstreams-kcql-0.1.jar 87 MB
kstreams-kcql-0.1-sources.jar 5 KB
kstreams-kcql-0.1-scaladoc.jar 373 KB
kstreams-kcql-0.1-javadoc.jar 261 bytes
Browse

How to add to project

<!-- https://jarcasting.com/artifacts/com.datamountaineer/kstreams-kcql/ -->
<dependency>
    <groupId>com.datamountaineer</groupId>
    <artifactId>kstreams-kcql</artifactId>
    <version>0.1</version>
</dependency>
// https://jarcasting.com/artifacts/com.datamountaineer/kstreams-kcql/
implementation 'com.datamountaineer:kstreams-kcql:0.1'
// https://jarcasting.com/artifacts/com.datamountaineer/kstreams-kcql/
implementation ("com.datamountaineer:kstreams-kcql:0.1")
'com.datamountaineer:kstreams-kcql:jar:0.1'
<dependency org="com.datamountaineer" name="kstreams-kcql" rev="0.1">
  <artifact name="kstreams-kcql" type="jar" />
</dependency>
@Grapes(
@Grab(group='com.datamountaineer', module='kstreams-kcql', version='0.1')
)
libraryDependencies += "com.datamountaineer" % "kstreams-kcql" % "0.1"
[com.datamountaineer/kstreams-kcql "0.1"]

Dependencies

compile (13)

Group / Artifact Type Version
org.scala-lang : scala-library jar 2.11.7
org.scala-lang : scala-compiler jar 2.11.7
com.typesafe.scala-logging : scala-logging-slf4j_2.11 jar 2.1.2
com.fasterxml.jackson.core : jackson-core jar 2.8.5
com.fasterxml.jackson.core : jackson-annotations jar 2.8.5
com.fasterxml.jackson.core : jackson-databind jar 2.8.5
org.json4s : json4s-jackson_2.11 jar 3.5.0
org.json4s : json4s-native_2.11 jar 3.5.0
org.apache.avro : avro jar 1.8.1
com.sksamuel.avro4s : avro4s-core_2.11 jar 1.6.2
com.datamountaineer : kcql jar 2.0.9
com.datamountaineer : avro-kcql jar 0.2
com.datamountaineer : json-kcql jar 0.3

test (17)

Group / Artifact Type Version
org.apache.kafka : kafka-streams jar 0.10.2.0
org.mockito : mockito-core jar 2.7.13
org.scalacheck : scalacheck_2.11 jar 1.11.1
org.scalatest : scalatest_2.11 jar 2.2.6
junit : junit jar 4.12
org.apache.curator : curator-test jar 3.1.0
org.powermock : powermock-module-junit4 jar 1.6.5
org.pegdown : pegdown jar 1.1.0
io.confluent » kafka-schema-registry jar 3.2.0
io.confluent » kafka-schema-registry-client jar 3.2.0
org.apache.kafka : kafka_2.11 jar 0.10.2.0
org.apache.kafka : kafka_2.11 jar 0.10.2.0
org.apache.kafka : kafka-clients jar 0.10.2.0
io.confluent » common-config jar 3.2.0
io.confluent » common-utils jar 3.2.0
org.bouncycastle : bcpkix-jdk15on jar 1.54
org.apache.directory.api : api-all jar 1.0.0-M33

Project Modules

There are no modules declared in this project.

Actions Status Kafka Connect Common is in Maven, include it in your connector.

Releases

Version Confluent Version Kafka Kcql Version Scala Version
2.0.5 5.4.0 2.4.0 2.8.7 2.12
2.0.4 5.4.0 2.4.0 2.8.7 2.12
2.0.3 5.4.0 2.4.0 2.8.6 2.12
2.0.2 5.4.0 2.4.0 2.8.5 2.12
2.0.1 5.4.0 2.4.0 2.8.4 2.12
2.0.0 5.4.0 2.4.0 2.8.4 2.12
1.1.9 5.0.0 1.1.0 2.8.4 2.11
1.1.8 5.0.0 1.1.0 2.8.4 2.11
1.1.5 5.0.0 1.1.0 2.8.2 2.11
1.1.5 4.1.0 1.1.0 2.8.2 2.11
1.1.4 4.1.0 1.1.0 2.8.2 2.11
1.1.3 4.1.0 1.1.0 2.8 2.11
1.1.2 4.1.0 1.1.0 2.7 2.11
1.1.1 4.1.0 1.1.0 2.5.1 2.11
1.1.0 4.1.0 1.1.0 2.5.1 2.11
1.0.9 4.0.0 1.0.0 2.5.1 2.11
1.0.8 4.0.0 1.0.0 2.5.1 2.11
1.0.7 4.0.0 1.0.0 2.5.1 2.11
1.0.6 4.0.0 1.0.0 2.5.1 2.11
1.0.5 4.0.0 1.0.0 2.5.1 2.11
1.0.4 4.0.0 1.0.0 2.5.1 2.11
1.0.3 4.0.0 1.0.0 2.4 2.11
1.0.2 4.0.0 1.0.0 2.4 2.11
1.0.1 4.0.0 1.0.0 2.4 2.11
1.0.2 4.0.0 1.0.0 2.4 2.11
1.0.1 4.0.0 1.0.0 2.4 2.11
1.0.0 4.0.0 1.0.0 2.4 2.11 
#maven
<dependency>
	<groupId>com.datamountaineer</groupId>
	<artifactId>kafka-connect-common</artifactId>
	<version>LATEST</version>
</dependency>

kafka-connect-common

Common components used across the datamountaineer kafka connect connectors.

Packages

Config

SSLConfigConext

Contains class for SSL Context configuration for supplied trust and keystores.

Offsets

The offset handler retrieves, from Kafka the stored offset map per source partition.

Queues

Helper methods to drain LinkedBlockingQueues.

Sink

Contains Writer and KeyBuilder classes.

DbWriter

Defines the contract for inserting a new row for the connect sink record.

KeyBuilder

  • Builds the new record key for the given connect SinkRecord.
  • Builds a new key from the payload fields specified.

Schemas

  • RestService to integrate with the Schema Registry

PayloadFields

Works out the fields and their mappings to be used when inserting a new row.

ConvertUtil

Converts source and sink records to JSON and Avro and back.

StructFieldsExtractor

Extracts fields from a SinkRecord Struct based on a specified set of provided columns.

com.datamountaineer

Versions

Version
0.1