hazelcast-jet-contrib
This repository includes various community supported and incubating modules for Hazelcast Jet.
As a general guideline, the following types of modules are encouraged in this repository:
- Various connectors, including both sources and sinks
- Service Factories. that potentially integrate with other systems.
- Custom aggregations. These should be generic enough that they should be reusable in other pipelines.
Building from source
To build the project, use the following command
./gradlew build
To publish project modules to the Maven Local repository, use the command
./gradlew publishToMavenLocal
List of modules
InfluxDb Connector
A Hazelcast Jet Connector for InfluxDb which enables Hazelcast Jet pipelines to read/write data points from/to InfluxDb.
Probabilistic Aggregations
A collection of probabilistic aggregations such as HyperLogLog.
Redis Connectors
Hazelcast Jet connectors for various Redis data structures.
MongoDB Connector
A Hazelcast Jet connector for MongoDB for querying/inserting objects from/to MongoDB.
Kafka Connect Connector
A generic Kafka Connect source provides ability to plug any Kafka Connect source for data ingestion to Jet pipelines.
Twitter Connector
A Hazelcast Jet connector for consuming data from Twitter stream sources in Jet pipelines.
Pulsar Connector
A Hazelcast Jet connector for consuming/producing messages from/to Apache Pulsar topics.
XA Tests
Tests to check compatibility of the XA support in your JMS broker or JDBC database with Jet's fault tolerance.
Hazelcast Jet Spring Boot Starter
A Spring Boot Starter for Hazelcast Jet which auto-configures Hazelcast Jet if found on the classpath.
HTTP(S) Listener Connector
A Hazelcast Jet Listener Connector for listening incoming HTTP requests as a source and sending messages(websocket) or events(server-sent-event) to the listening clients as a sink.
Snapshot Releases
To access snapshot builds add the following dependency
and repository
declarations to dependencies
and repositories
sections in your pom.xml
respectively.
<dependency>
<groupId>com.hazelcast.jet.contrib</groupId>
<artifactId>${module.name}</artifactId>
<version>${module.version}</version>
</dependency>
<repository>
<id>sonatype-snapshots</id>
<name>Sonatype Snapshot Repository</name>
<url>https://oss.sonatype.org/content/repositories/snapshots</url>
<releases>
<enabled>false</enabled>
</releases>
<snapshots>
<enabled>true</enabled>
</snapshots>
</repository>
Contributing
We encourage pull requests and process them promptly.
To contribute:
- see Contribution Guideline
- see Developing with Git for our Git process
- see README Template
- complete the Hazelcast Contributor Agreement
Submit your contribution as a pull request on GitHub.
License
This project is licensed under the Apache 2.0 license - see the LICENSE file for details