LegStar Avro Maven Plugin

Produces Avro artifacts for a set of COBOL copybooks

License	GNU AFFERO GENERAL PUBLIC LICENSE
Categories	Maven Build Tools
GroupId	com.legsem.legstar
ArtifactId	legstar-avro-maven-plugin
Last Version	0.4.2
Release Date	Feb 26, 2015
Type	maven-plugin
Description	LegStar Avro Maven Plugin Produces Avro artifacts for a set of COBOL copybooks
Project Organization	LegSem

Download legstar-avro-maven-plugin

Filename	Size
legstar-avro-maven-plugin-0.4.2.pom
legstar-avro-maven-plugin-0.4.2.jar	7 KB
legstar-avro-maven-plugin-0.4.2-sources.jar	1 KB
legstar-avro-maven-plugin-0.4.2-javadoc.jar	22 KB

How to add to project

Apache Maven

<plugin>
    <groupId>com.legsem.legstar</groupId>
    <artifactId>legstar-avro-maven-plugin</artifactId>
    <version>0.4.2</version>
</plugin>

Dependencies

compile (5)

Group / Artifact	Type	Version
com.legsem.legstar : legstar.avro.generator	jar	0.4.2
com.legsem.legstar : legstar-maven-plugin	jar	2.0.4
commons-io : commons-io	jar	2.4
org.slf4j : slf4j-api	jar	1.7.2
org.slf4j : slf4j-log4j12	jar	1.7.2

provided (2)

Group / Artifact	Type	Version
org.apache.maven : maven-plugin-api	jar	3.2.5
org.apache.maven.plugin-tools : maven-plugin-annotations	jar	3.2

test (4)

Group / Artifact	Type	Version
junit : junit	jar	4.11
org.apache.maven.plugin-testing : maven-plugin-testing-harness	jar	3.3.0
org.apache.maven : maven-core	jar	3.2.5
org.apache.maven : maven-compat	jar	3.2.5

Project Modules

There are no modules declared in this project.

legstar.avro

A COBOL to Apache Avro translator based on LegStar

The idea is that mainframe data might be useful in environments where Apache Avro records are commonplace. One such environment is Hadoop where MapReduce jobs can read/write Avro records.

Legstar.avro helps deliver mainframe data as Avro records.

Objectives

• Provide a Generator to produce artifacts from a COBOL copybook:

  • Avro Schema matching the COBOL copybook

  • Conversion logic to turn mainframe records to Avro Generic records

  • Avro specific records compiled from the Avro schema

• Readers for pure Java, or Hadoop, that read mainframe files and deliver an Avro record for each mainframe record

Requirements

• Java JDK 6 and above (It is important that this is a JDK not a simple JRE)

• Maven 3 (If you build from sources)

• Ant 1.9.x (To run samples)

• Hadoop 2.4.1 (To run the Hadoop sample)

Build from sources

1. Clone the GIT repository

2. From a command window, while located in the folder where you cloned the repo, type:

mvn clean install

Run the samples

If you built the project from sources, you will find the distribution zip file under legstar.avro/legstar.avro.distrib/target.

Otherwise you can get the latest released zip here.

Unzip the zip file in a location of your choice.

1. Run the CustdatReader sample

Go to the samples folder and type:

ant

You can get more information on the CustdatReader sample provided on the wiki

2. Run the CustdatHadoopReader sample

Go to the samples folder and type:

ant -f build-hadoop.xml

You can get more information on the CustdatHadoopReader sample provided on the wiki

Versions

Version
0.4.2 Feb 26, 2015