org.pragmaticminds.crunch:streaming-connectors

Parent project for crunch

License

License

GroupId

GroupId

org.pragmaticminds.crunch
ArtifactId

ArtifactId

streaming-connectors
Last Version

Last Version

0.3.2
Release Date

Release Date

Type

Type

pom
Description

Description

Parent project for crunch
Project Organization

Project Organization

pragmatic minds GmbH

Download streaming-connectors

How to add to project

<!-- https://jarcasting.com/artifacts/org.pragmaticminds.crunch/streaming-connectors/ -->
<dependency>
    <groupId>org.pragmaticminds.crunch</groupId>
    <artifactId>streaming-connectors</artifactId>
    <version>0.3.2</version>
    <type>pom</type>
</dependency>
// https://jarcasting.com/artifacts/org.pragmaticminds.crunch/streaming-connectors/
implementation 'org.pragmaticminds.crunch:streaming-connectors:0.3.2'
// https://jarcasting.com/artifacts/org.pragmaticminds.crunch/streaming-connectors/
implementation ("org.pragmaticminds.crunch:streaming-connectors:0.3.2")
'org.pragmaticminds.crunch:streaming-connectors:pom:0.3.2'
<dependency org="org.pragmaticminds.crunch" name="streaming-connectors" rev="0.3.2">
  <artifact name="streaming-connectors" type="pom" />
</dependency>
@Grapes(
@Grab(group='org.pragmaticminds.crunch', module='streaming-connectors', version='0.3.2')
)
libraryDependencies += "org.pragmaticminds.crunch" % "streaming-connectors" % "0.3.2"
[org.pragmaticminds.crunch/streaming-connectors "0.3.2"]

Dependencies

test (1)

Group / Artifact Type Version
org.slf4j : slf4j-simple jar 1.7.25

Project Modules

  • flink
  • base
  • chronicle
  • kafka
  • postgresql

Readme

Build Status Maven Central Apache License, Version 2.0

Welcome to CRUNCH an industrial streaming data analysis framework built by pragmatic minds GmbH.

About

When dealing with data streams from industrial applications, e.g., machines there are often times very similar questions and processing steps necessary. Think, e.g., of filtering or joining data from different sources. Futhermore, more complex tasks are differentiation of signals (to monitor changes) or even application of Fourrier transformation (or related wavelet transformation). These signals can then be analysed with regards to a set of built-in functions or custom functions. What all of the functions have in common is, that you always have the temporal context of a datapoint. Thus, it is easy to ask

When did this bit change from false to true?

or things like

When is the steepness of this signal larger than ... for more than ... seconds

or

Emit an event each time when the signal is above ...

What makes CRUNCH different from other Frameworks like Apache Flink, Apache Spark, Akka Streams, ...

There are many open source frameworks for stream processing. The main difference between them and CRUNCH is that CRUNCH is very focused about it's application in signal processing and related tasks and no general streaming framework. Futhermore, as this kind of analysis is often done on the edge CRUNCH is not very focused on scaling and fault tolerance in specific situations as this is not (that) relevant for edge devices.

Further Information

Please see on our homepage here: https://pragmaticminds.github.io/crunch/

Developers

To generate the Homepage, just call mvn clean site site:stage scm-publish:publish-scm.

Contact

Obviuously, this readme is still beeing populated and we are still setting up our infrastructure (after open sourcing CRUNCH). So if you have any questions please feel free to ask one of the commiters or write an email to Julian.

Versions

Version
0.3.2
0.3.1
0.3.0
0.2.1
0.2.0