kafka-connect

Generic Kafka Connect source provides ability to plug any Kafka Connect source for data ingestion to Jet pipelines.

License	The Apache License, Version 2.0
Categories	Hazelcast Application Layer Libs Distributed Applications
GroupId	com.hazelcast.jet.contrib
ArtifactId	kafka-connect
Last Version	0.1
Release Date	Mar 9, 2020
Type	jar
Description	kafka-connect Generic Kafka Connect source provides ability to plug any Kafka Connect source for data ingestion to Jet pipelines.

Download kafka-connect

Filename	Size
kafka-connect-0.1.pom
kafka-connect-0.1.jar	9 KB
kafka-connect-0.1-sources.jar	4 KB
kafka-connect-0.1-javadoc.jar	19 KB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/com.hazelcast.jet.contrib/kafka-connect/ -->
<dependency>
    <groupId>com.hazelcast.jet.contrib</groupId>
    <artifactId>kafka-connect</artifactId>
    <version>0.1</version>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/com.hazelcast.jet.contrib/kafka-connect/
implementation 'com.hazelcast.jet.contrib:kafka-connect:0.1'

Gradle Kotlin

// https://jarcasting.com/artifacts/com.hazelcast.jet.contrib/kafka-connect/
implementation ("com.hazelcast.jet.contrib:kafka-connect:0.1")

Apache Buildr

'com.hazelcast.jet.contrib:kafka-connect:jar:0.1'

Apache Ivy

<dependency org="com.hazelcast.jet.contrib" name="kafka-connect" rev="0.1">
  <artifact name="kafka-connect" type="jar" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='com.hazelcast.jet.contrib', module='kafka-connect', version='0.1')
)

Scala SBT

libraryDependencies += "com.hazelcast.jet.contrib" % "kafka-connect" % "0.1"

Leiningen

[com.hazelcast.jet.contrib/kafka-connect "0.1"]

Dependencies

compile (3)

Group / Artifact	Type	Version
com.hazelcast.jet : hazelcast-jet	jar	4.0
com.google.code.findbugs : jsr305	jar	3.0.2
org.apache.kafka : connect-api	jar	2.3.0

Project Modules

There are no modules declared in this project.

hazelcast-jet-contrib

This repository includes various community supported and incubating modules for Hazelcast Jet.

As a general guideline, the following types of modules are encouraged in this repository:

• Various connectors, including both sources and sinks
• Service Factories. that potentially integrate with other systems.
• Custom aggregations. These should be generic enough that they should be reusable in other pipelines.

Building from source

To build the project, use the following command

./gradlew build

To publish project modules to the Maven Local repository, use the command

./gradlew publishToMavenLocal

List of modules

InfluxDb Connector

A Hazelcast Jet Connector for InfluxDb which enables Hazelcast Jet pipelines to read/write data points from/to InfluxDb.

Probabilistic Aggregations

A collection of probabilistic aggregations such as HyperLogLog.

Redis Connectors

Hazelcast Jet connectors for various Redis data structures.

MongoDB Connector

A Hazelcast Jet connector for MongoDB for querying/inserting objects from/to MongoDB.

Kafka Connect Connector

A generic Kafka Connect source provides ability to plug any Kafka Connect source for data ingestion to Jet pipelines.

Twitter Connector

A Hazelcast Jet connector for consuming data from Twitter stream sources in Jet pipelines.

Pulsar Connector

A Hazelcast Jet connector for consuming/producing messages from/to Apache Pulsar topics.

XA Tests

Tests to check compatibility of the XA support in your JMS broker or JDBC database with Jet's fault tolerance.

Hazelcast Jet Spring Boot Starter

A Spring Boot Starter for Hazelcast Jet which auto-configures Hazelcast Jet if found on the classpath.

HTTP(S) Listener Connector

A Hazelcast Jet Listener Connector for listening incoming HTTP requests as a source and sending messages(websocket) or events(server-sent-event) to the listening clients as a sink.

Snapshot Releases

To access snapshot builds add the following dependency and repository declarations to dependencies and repositories sections in your pom.xml respectively.

<dependency>
  <groupId>com.hazelcast.jet.contrib</groupId>
  <artifactId>${module.name}</artifactId>
  <version>${module.version}</version>
</dependency>

<repository>
    <id>sonatype-snapshots</id>
    <name>Sonatype Snapshot Repository</name>
    <url>https://oss.sonatype.org/content/repositories/snapshots</url>
    <releases>
        <enabled>false</enabled>
    </releases>
    <snapshots>
        <enabled>true</enabled>
    </snapshots>
</repository>

Contributing

We encourage pull requests and process them promptly.

To contribute:

• see Contribution Guideline
• see Developing with Git for our Git process
• see README Template
• complete the Hazelcast Contributor Agreement

Submit your contribution as a pull request on GitHub.

License

This project is licensed under the Apache 2.0 license - see the LICENSE file for details

hazelcast

Hazelcast, the leading in-memory computing platform

Versions

Version
0.1 Mar 9, 2020