akka-persistence-ignite

Ignite persistence journal plugin for akka persistence

License

License

Categories

Categories

Akka Container Microservices Reactive libraries
GroupId

GroupId

io.github.romeh
ArtifactId

ArtifactId

akka-persistence-ignite
Last Version

Last Version

1.1.1
Release Date

Release Date

Type

Type

jar
Description

Description

akka-persistence-ignite
Ignite persistence journal plugin for akka persistence
Project URL

Project URL

https://github.com/Romeh/akka-persistance-ignite
Source Code Management

Source Code Management

https://github.com/Romeh/akka-persistance-ignite

Download akka-persistence-ignite

How to add to project

<!-- https://jarcasting.com/artifacts/io.github.romeh/akka-persistence-ignite/ -->
<dependency>
    <groupId>io.github.romeh</groupId>
    <artifactId>akka-persistence-ignite</artifactId>
    <version>1.1.1</version>
</dependency>
// https://jarcasting.com/artifacts/io.github.romeh/akka-persistence-ignite/
implementation 'io.github.romeh:akka-persistence-ignite:1.1.1'
// https://jarcasting.com/artifacts/io.github.romeh/akka-persistence-ignite/
implementation ("io.github.romeh:akka-persistence-ignite:1.1.1")
'io.github.romeh:akka-persistence-ignite:jar:1.1.1'
<dependency org="io.github.romeh" name="akka-persistence-ignite" rev="1.1.1">
  <artifact name="akka-persistence-ignite" type="jar" />
</dependency>
@Grapes(
@Grab(group='io.github.romeh', module='akka-persistence-ignite', version='1.1.1')
)
libraryDependencies += "io.github.romeh" % "akka-persistence-ignite" % "1.1.1"
[io.github.romeh/akka-persistence-ignite "1.1.1"]

Dependencies

compile (5)

Group / Artifact Type Version
com.typesafe.akka : akka-persistence_2.12 jar 2.5.18
org.apache.ignite : ignite-core jar 2.7.0
org.apache.ignite : ignite-indexing jar 2.7.0
org.apache.ignite : ignite-spring jar 2.7.0
org.slf4j : slf4j-api jar 1.7.25

provided (1)

Group / Artifact Type Version
org.projectlombok : lombok jar 1.16.18

test (6)

Group / Artifact Type Version
ch.qos.logback : logback-classic jar 1.2.3
com.typesafe.akka : akka-cluster_2.12 jar 2.5.18
com.typesafe.akka : akka-cluster-tools_2.12 jar 2.5.18
com.typesafe.akka : akka-persistence-tck_2.12 jar 2.5.18
org.scalatest : scalatest_2.12 jar 3.0.4
junit : junit jar 4.12

Project Modules

There are no modules declared in this project.

akka-persistence-ignite (Java API)Twitter Follow

Codacy Badge

Build Status Maven Central

A journal and snapshot store plugin for Akka Persistence using Apache Ignite.

alt text

This is mainly using Apache ignite with akka persistence to provide journal and snapshot store by using the partitioned caches and benefit from the distributed highly available data grid features plus the nice query and data computations features in Ignite that can be used to have normalized views from the event store and do analytical jobs over them despite it is advised to keep write nodes separate from read nodes for better scalability

Akka and Ignite used versions:

Akka version :2.5.18+ , Ignite Version :2.7.0+

Journal plugin

  • All operations required by the Akka Persistence journal plugin API are fully supported.
  • it support storing the tags of the events (event tagging)
  • It use Apache Ignite binary serialization for its queries
  • Events serialization will be based into the types serializers definition in your Akka configuration
  • It use apache ignite partitioned cache with default number of backups to 1 , that can be changed into reference.conf file.

Snapshot store plugin

How to use

Enable plugins

akka.persistence.journal.plugin = "akka.persistence.journal.ignite"
akka.persistence.snapshot-store.plugin = "akka.persistence.snapshot.ignite"

Maven dependency

        <dependency>
            <groupId>io.github.romeh</groupId>
            <artifactId>akka-persistence-ignite</artifactId>
            <version>1.1.1</version>
        </dependency>

please check the project pom.xml for maven repo configuration

Configure Ignite data grid properties , default configured on localhost.

ignite {
  //to start client or server node to connect to Ignite data cluster 
  isClientNode = false
  // for ONLY testing we use localhost
  // used for grid cluster connectivity
  tcpDiscoveryAddresses = "localhost"
  metricsLogFrequency = 0
  // thread pools used by Ignite , should based into target machine specs
  queryThreadPoolSize = 4
  dataStreamerThreadPoolSize = 1
  managementThreadPoolSize = 2
  publicThreadPoolSize = 4
  systemThreadPoolSize = 2
  rebalanceThreadPoolSize = 1
  asyncCallbackPoolSize = 4
  peerClassLoadingEnabled = false
  // to enable or disable durable memory persistance
  enableFilePersistence = true
  // used for grid cluster connectivity, change it to suit your configuration 
  igniteConnectorPort = 11211
  // used for grid cluster connectivity , change it to suit your configuration 
  igniteServerPortRange = "47500..47509"
  //durable memory persistance storage file system path , change it to suit your configuration 
  ignitePersistenceFilePath = "./data"
}

Contributions are more then welcomed:

Please free to jump and help will be highly appreciated

TODO (enhancement issues created for tracking):

  • Persistence Query to be implemented but it could be not needed as we can use the Apache Ignite sql and text query capabilities
  • Performance testing policy needed to be defined and executed
  • Adding HTTPS support
  • Performance test ignite client node vs server node connectivity

Versions

Version
1.1.1
1.1.0