JarCasting
JarCasting JarCasting

LegStar Avro Maven Plugin

Produces Avro artifacts for a set of COBOL copybooks

License

License
Categories

Categories

Maven Build Tools
GroupId

GroupId

com.legsem.legstar
ArtifactId

ArtifactId

legstar-avro-maven-plugin
Last Version

Last Version

0.4.2
Release Date

Release Date
Type

Type

maven-plugin
Description

Description

LegStar Avro Maven Plugin
Produces Avro artifacts for a set of COBOL copybooks
Project Organization

Project Organization

LegSem

Download legstar-avro-maven-plugin

Filename Size
legstar-avro-maven-plugin-0.4.2.pom
legstar-avro-maven-plugin-0.4.2.jar 7 KB
legstar-avro-maven-plugin-0.4.2-sources.jar 1 KB
legstar-avro-maven-plugin-0.4.2-javadoc.jar 22 KB
Browse

How to add to project

<plugin>
    <groupId>com.legsem.legstar</groupId>
    <artifactId>legstar-avro-maven-plugin</artifactId>
    <version>0.4.2</version>
</plugin>

Dependencies

compile (5)

Group / Artifact Type Version
com.legsem.legstar : legstar.avro.generator jar 0.4.2
com.legsem.legstar : legstar-maven-plugin jar 2.0.4
commons-io : commons-io jar 2.4
org.slf4j : slf4j-api jar 1.7.2
org.slf4j : slf4j-log4j12 jar 1.7.2

provided (2)

Group / Artifact Type Version
org.apache.maven : maven-plugin-api jar 3.2.5
org.apache.maven.plugin-tools : maven-plugin-annotations jar 3.2

test (4)

Group / Artifact Type Version
junit : junit jar 4.11
org.apache.maven.plugin-testing : maven-plugin-testing-harness jar 3.3.0
org.apache.maven : maven-core jar 3.2.5
org.apache.maven : maven-compat jar 3.2.5

Project Modules

There are no modules declared in this project.

legstar.avro

A COBOL to Apache Avro translator based on LegStar

The idea is that mainframe data might be useful in environments where Apache Avro records are commonplace. One such environment is Hadoop where MapReduce jobs can read/write Avro records.

Legstar.avro helps deliver mainframe data as Avro records.

Objectives

  • Provide a Generator to produce artifacts from a COBOL copybook:

    • Avro Schema matching the COBOL copybook

    • Conversion logic to turn mainframe records to Avro Generic records

    • Avro specific records compiled from the Avro schema

  • Readers for pure Java, or Hadoop, that read mainframe files and deliver an Avro record for each mainframe record

Overview

Requirements

  • Java JDK 6 and above (It is important that this is a JDK not a simple JRE)

  • Maven 3 (If you build from sources)

  • Ant 1.9.x (To run samples)

  • Hadoop 2.4.1 (To run the Hadoop sample)

Build from sources

  1. Clone the GIT repository

  2. From a command window, while located in the folder where you cloned the repo, type:

mvn clean install

Run the samples

If you built the project from sources, you will find the distribution zip file under legstar.avro/legstar.avro.distrib/target.

Otherwise you can get the latest released zip here.

Unzip the zip file in a location of your choice.

1. Run the CustdatReader sample

Go to the samples folder and type:

ant

You can get more information on the CustdatReader sample provided on the wiki

2. Run the CustdatHadoopReader sample

Go to the samples folder and type:

ant -f build-hadoop.xml

You can get more information on the CustdatHadoopReader sample provided on the wiki

Versions

Version
0.4.2