kstreams-sql-transform_2.11

Small utility lib for Kafka Streams to help with simple payload transformations

License	Apache License 2.0
Categories	MS SQL Data Databases ORM
GroupId	com.landoop
ArtifactId	kstreams-sql-transform_2.11
Last Version	0.1
Release Date	Apr 22, 2017
Type	jar
Description	kstreams-sql-transform_2.11 Small utility lib for Kafka Streams to help with simple payload transformations
Project URL	https://github.com/datamountaineer/kafka-connect-common
Source Code Management	https://github.com/datamountaineer/kafka-connect-common.git

Download kstreams-sql-transform_2.11

Filename	Size
kstreams-sql-transform_2.11-0.1.pom
kstreams-sql-transform_2.11-0.1.jar	86 KB
kstreams-sql-transform_2.11-0.1-sources.jar	8 KB
kstreams-sql-transform_2.11-0.1-scaladoc.jar	387 KB
kstreams-sql-transform_2.11-0.1-javadoc.jar	261 bytes

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/com.landoop/kstreams-sql-transform_2.11/ -->
<dependency>
    <groupId>com.landoop</groupId>
    <artifactId>kstreams-sql-transform_2.11</artifactId>
    <version>0.1</version>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/com.landoop/kstreams-sql-transform_2.11/
implementation 'com.landoop:kstreams-sql-transform_2.11:0.1'

Gradle Kotlin

// https://jarcasting.com/artifacts/com.landoop/kstreams-sql-transform_2.11/
implementation ("com.landoop:kstreams-sql-transform_2.11:0.1")

Apache Buildr

'com.landoop:kstreams-sql-transform_2.11:jar:0.1'

Apache Ivy

<dependency org="com.landoop" name="kstreams-sql-transform_2.11" rev="0.1">
  <artifact name="kstreams-sql-transform_2.11" type="jar" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='com.landoop', module='kstreams-sql-transform_2.11', version='0.1')
)

Scala SBT

libraryDependencies += "com.landoop" % "kstreams-sql-transform_2.11" % "0.1"

Leiningen

[com.landoop/kstreams-sql-transform_2.11 "0.1"]

Dependencies

compile (11)

Group / Artifact	Type	Version
org.scala-lang : scala-library	jar	2.11.8
com.typesafe.scala-logging : scala-logging_2.11	jar	3.5.0
com.fasterxml.jackson.core : jackson-core	jar	2.8.5
com.fasterxml.jackson.core : jackson-databind	jar	2.8.5
com.fasterxml.jackson.core : jackson-annotations	jar	2.8.5
org.json4s : json4s-jackson_2.11	jar	3.5.0
org.json4s : json4s-native_2.11	jar	3.5.0
org.apache.avro : avro	jar	1.8.1
com.sksamuel.avro4s : avro4s-core_2.11	jar	1.6.2
com.landoop : avro-sql_2.11	jar	0.3
com.landoop : json-sql_2.11	jar	0.4

test (17)

Group / Artifact	Type	Version
org.mockito : mockito-core	jar	2.7.13
org.scalacheck : scalacheck_2.11	jar	1.11.1
org.scalatest : scalatest_2.11	jar	2.2.6
junit : junit	jar	4.12
org.apache.curator : curator-test	jar	3.1.0
org.powermock : powermock-module-junit4	jar	1.6.5
org.pegdown : pegdown	jar	1.1.0
io.confluent » kafka-schema-registry	jar	3.2.0
io.confluent » kafka-schema-registry-client	jar	3.2.0
org.apache.kafka : kafka_2.11	jar	0.10.2.0
org.apache.kafka : kafka_2.11	jar	0.10.2.0
org.apache.kafka : kafka-streams	jar	0.10.2.0
org.apache.kafka : kafka-clients	jar	0.10.2.0
io.confluent » common-config	jar	3.2.0
io.confluent » common-utils	jar	3.2.0
org.bouncycastle : bcpkix-jdk15on	jar	1.54
org.apache.directory.api : api-all	jar	1.0.0-M33

Project Modules

There are no modules declared in this project.

Kafka Connect Common is in Maven, include it in your connector.

Releases

Version	Confluent Version	Kafka	Kcql Version	Scala Version
2.0.5	5.4.0	2.4.0	2.8.7	2.12
2.0.4	5.4.0	2.4.0	2.8.7	2.12
2.0.3	5.4.0	2.4.0	2.8.6	2.12
2.0.2	5.4.0	2.4.0	2.8.5	2.12
2.0.1	5.4.0	2.4.0	2.8.4	2.12
2.0.0	5.4.0	2.4.0	2.8.4	2.12
1.1.9	5.0.0	1.1.0	2.8.4	2.11
1.1.8	5.0.0	1.1.0	2.8.4	2.11
1.1.5	5.0.0	1.1.0	2.8.2	2.11
1.1.5	4.1.0	1.1.0	2.8.2	2.11
1.1.4	4.1.0	1.1.0	2.8.2	2.11
1.1.3	4.1.0	1.1.0	2.8	2.11
1.1.2	4.1.0	1.1.0	2.7	2.11
1.1.1	4.1.0	1.1.0	2.5.1	2.11
1.1.0	4.1.0	1.1.0	2.5.1	2.11
1.0.9	4.0.0	1.0.0	2.5.1	2.11
1.0.8	4.0.0	1.0.0	2.5.1	2.11
1.0.7	4.0.0	1.0.0	2.5.1	2.11
1.0.6	4.0.0	1.0.0	2.5.1	2.11
1.0.5	4.0.0	1.0.0	2.5.1	2.11
1.0.4	4.0.0	1.0.0	2.5.1	2.11
1.0.3	4.0.0	1.0.0	2.4	2.11
1.0.2	4.0.0	1.0.0	2.4	2.11
1.0.1	4.0.0	1.0.0	2.4	2.11
1.0.2	4.0.0	1.0.0	2.4	2.11
1.0.1	4.0.0	1.0.0	2.4	2.11
1.0.0	4.0.0	1.0.0	2.4	2.11

#maven
<dependency>
	<groupId>com.datamountaineer</groupId>
	<artifactId>kafka-connect-common</artifactId>
	<version>LATEST</version>
</dependency>

kafka-connect-common

Common components used across the datamountaineer kafka connect connectors.

Packages

Config

SSLConfigConext

Contains class for SSL Context configuration for supplied trust and keystores.

Offsets

The offset handler retrieves, from Kafka the stored offset map per source partition.

Queues

Helper methods to drain LinkedBlockingQueues.

Sink

Contains Writer and KeyBuilder classes.

DbWriter

Defines the contract for inserting a new row for the connect sink record.

KeyBuilder

• Builds the new record key for the given connect SinkRecord.
• Builds a new key from the payload fields specified.

Schemas

• RestService to integrate with the Schema Registry

PayloadFields

Works out the fields and their mappings to be used when inserting a new row.

ConvertUtil

Converts source and sink records to JSON and Avro and back.

StructFieldsExtractor

Extracts fields from a SinkRecord Struct based on a specified set of provided columns.

Versions

Version
0.1 Apr 22, 2017