oozielogger

Oozielogger is a application to continuously replicate oozie events into mysql/postgres databes. this includes any of coordinator start, stop, failure, SLA etc.. workflow start, stop, failure, SLA evts this basically consume Oozie's ActiveMQ queue and post back to database so that, end user reporting can happen.

License

License

GroupId

GroupId

io.github.bkosaraju
ArtifactId

ArtifactId

oozielogger_2.12
Last Version

Last Version

1.0
Release Date

Release Date

Type

Type

zip
Description

Description

oozielogger
Oozielogger is a application to continuously replicate oozie events into mysql/postgres databes. this includes any of coordinator start, stop, failure, SLA etc.. workflow start, stop, failure, SLA evts this basically consume Oozie's ActiveMQ queue and post back to database so that, end user reporting can happen.
Project URL

Project URL

https://bkosaraju.github.io/oozielogger
Source Code Management

Source Code Management

https://github.com/bkosaraju/oozielogger

Download oozielogger_2.12

Dependencies

compile (13)

Group / Artifact Type Version
org.scala-lang : scala-library jar 2.12.12
ch.qos.logback : logback-classic jar 1.2.3
ch.qos.logback : logback-core jar 1.2.3
org.slf4j : jcl-over-slf4j jar 1.7.25
org.slf4j : log4j-over-slf4j jar 1.7.25
org.slf4j : slf4j-api jar 1.7.25
org.apache.activemq : activemq-core jar 5.7.0
org.apache.oozie : oozie-client jar 4.2.0
com.fasterxml.jackson.module : jackson-module-scala_2.11 jar 2.9.5
com.zaxxer : HikariCP jar 3.1.0
org.mariadb.jdbc : mariadb-java-client jar 2.2.3
org.springframework : spring-jdbc jar 4.3.18.RELEASE
commons-io : commons-io jar 2.4

Project Modules

There are no modules declared in this project.

Oozielogger

Oozielogger is a application to continuously replicate oozie events into mysql/postgres databes.

this includes any of coordinator start, stop, failure, SLA etc.. workflow start, stop, failure, SLA evts

this basically consume Oozie's ActiveMQ queue and post back to database so that, end user reporting can happen.

Application Properties

Basic starting application properties to start.

any of the sensitive values can be upload into SSM and refer with secret. where application try to retrieve from amazon systems manager parameter store.

brokerUrl=tcp://localhost:61616
topicName=FALCON.ENTITY.TOPIC
connectionFactoryNames=ConnectionFactory
java.naming.factory.initial=org.apache.activemq.jndi.ActiveMQInitialContextFactory
jdbcType=mysql
jdbcHostname=localhost
jdbcPort=3306
jdbcDatabase=xxxxxxx
jdbcUsername=xxxxxx
jdbcPassword=xxxxxxxxxxx

Usage

java -jar piplien_2.12_<version>-all.jar  <properties file>

Where can I get the latest release?

You can get source from SCM.

Alternatively you can pull binaries from the central Maven repositories: For mvn:

<dependency>
  <groupId>io.github.bkosaraju</groupId>
  <artifactId>oozielogger_#ScalaVariant#</artifactId>
  <version>#Version#</version>
</dependency>
 
<!--Fat/ Assembly Jar-->
<dependency>
  <groupId>io.github.bkosaraju</groupId>
  <artifactId>oozielogger_#ScalaVariant#</artifactId>
  <version>#verion#</version>
  <classifier>all</classifier>
</dependency>

for Gradle:

    api group: "io.github.bkosaraju", name: "oozielogger_$scalaVariant", version: "$Version"

Build Instructions

./gradlew clean build

#Artifacts can be found in build/lib directory 

#Linux/Windows binaries can be found at build/distribution directory 

Scala Docs

Contributing

Please feel free to raise a pull request in case if you feel like something can be updated or contributed

License

Apache

Versions

Version
1.0