Egeria Connector for Apache Atlas

An OCF OMRS Repository Connector for Apache Atlas (using its REST API to call into the Apache Atlas metadata repository).

License	The Apache Software License, Version 2.0 Creative Commons Attribution 4.0 International (CC BY 4.0)
GroupId	org.odpi.egeria
ArtifactId	egeria-connector-apache-atlas
Last Version	1.6
Release Date	Apr 15, 2020
Type	pom
Description	Egeria Connector for Apache Atlas An OCF OMRS Repository Connector for Apache Atlas (using its REST API to call into the Apache Atlas metadata repository).
Project Organization	ODPi
Source Code Management	http://github.com/odpi/egeria-connector-apache-atlas/tree/master

Download egeria-connector-apache-atlas

Filename	Size
egeria-connector-apache-atlas-1.6.pom	39 KB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/org.odpi.egeria/egeria-connector-apache-atlas/ -->
<dependency>
    <groupId>org.odpi.egeria</groupId>
    <artifactId>egeria-connector-apache-atlas</artifactId>
    <version>1.6</version>
    <type>pom</type>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/org.odpi.egeria/egeria-connector-apache-atlas/
implementation 'org.odpi.egeria:egeria-connector-apache-atlas:1.6'

Gradle Kotlin

// https://jarcasting.com/artifacts/org.odpi.egeria/egeria-connector-apache-atlas/
implementation ("org.odpi.egeria:egeria-connector-apache-atlas:1.6")

Apache Buildr

'org.odpi.egeria:egeria-connector-apache-atlas:pom:1.6'

Apache Ivy

<dependency org="org.odpi.egeria" name="egeria-connector-apache-atlas" rev="1.6">
  <artifact name="egeria-connector-apache-atlas" type="pom" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='org.odpi.egeria', module='egeria-connector-apache-atlas', version='1.6')
)

Scala SBT

libraryDependencies += "org.odpi.egeria" % "egeria-connector-apache-atlas" % "1.6"

Leiningen

[org.odpi.egeria/egeria-connector-apache-atlas "1.6"]

Dependencies

test (1)

Group / Artifact	Type	Version
org.slf4j : slf4j-simple	jar	1.7.30

Project Modules

• adapter
• distribution

Hadoop Ecosystem Repository Connectors

This repository houses the ODPi Egeria connectors for various Hadoop ecosystem components:

• Apache Atlas connector implements read-only connectivity to the Apache Atlas metadata repository.
• Apache Ranger is a framework to enable, monitor and manage comprehensive data security across the Hadoop platform. (Coming soon.)

Getting started

TL;DR

The quick version:

1. Download the latest connectors from: https://odpi.jfrog.io/odpi/egeria-snapshot-local/org/odpi/egeria/egeria-connector-hadoop-ecosystem-package/2.6-SNAPSHOT/egeria-connector-hadoop-ecosystem-package-2.6-SNAPSHOT-jar-with-dependencies.jar
2. Download the latest Egeria core from: https://odpi.jfrog.io/odpi/egeria-snapshot-local/org/odpi/egeria/server-chassis-spring/2.6-SNAPSHOT/server-chassis-spring-2.6-SNAPSHOT.jar
3. Rename the downloaded Egeria core file to egeria-server-chassis-spring.jar.
4. Download the truststore.p12 file from: https://github.com/odpi/egeria/blob/master/truststore.p12
5. Run the following command to start Egeria from the command-line, waiting for the final line of output indicating the server is running and ready for configuration:

   $ export STRICT_SSL=false
   $ java -Dloader.path=. -jar egeria-server-chassis-spring.jar
    ODPi Egeria
       ____   __  ___ ___    ______   _____                                 ____   _         _     ___
      / __ \ /  |/  //   |  / ____/  / ___/ ___   ____ _   __ ___   ____   / _  \ / / __    / /  / _ /__   ____ _  _
     / / / // /|_/ // /| | / / __    \__ \ / _ \ / __/| | / // _ \ / __/  / /_/ // //   |  / _\ / /_ /  | /  _// || |
    / /_/ // /  / // ___ |/ /_/ /   ___/ //  __// /   | |/ //  __// /    /  __ // // /  \ / /_ /  _// / // /  / / / /
    \____//_/  /_//_/  |_|\____/   /____/ \___//_/    |___/ \___//_/    /_/    /_/ \__/\//___//_/   \__//_/  /_/ /_/
   
    :: Powered by Spring Boot (v2.2.2.RELEASE) ::
   
   
   No OMAG servers listed in startup configuration
   Thu Jan 02 11:30:10 GMT 2020 OMAG server platform ready for more configuration

6. Follow the detailed instructions for configuring the connector(s) you want to use, either Apache Atlas or Apache Ranger (coming soon).

Obtain the connector

You can either download the latest released or snapshot version of the connector directly from ODPi, or build the connector yourself. In both cases, once you have the jar file for the connector (egeria-connector-hadoop-ecosystem-package-VERSION-jar-with-dependencies.jar) this needs to be copied to a location where it can be run alongside the OMAG Server Platform from Egeria core itself. For example, this could be placing the file into the /lib directory as /lib/egeria-connector-hadoop-ecosystem-package-VERSION-jar-with-dependencies.jar.

Download from ODPi

To download a pre-built version of the connector, use either of the following URLs (depending on whether you want an officially-released version or the latest snapshot):

• Release: https://odpi.jfrog.io/odpi/egeria-release-local/org/odpi/egeria/egeria-connector-hadoop-ecosystem-package/2.5/egeria-connector-hadoop-ecosystem-package-2.5-jar-with-dependencies.jar
• Snapshot: https://odpi.jfrog.io/odpi/egeria-snapshot-local/org/odpi/egeria/egeria-connector-hadoop-ecosystem-package/2.6-SNAPSHOT/egeria-connector-hadoop-ecosystem-package-2.6-SNAPSHOT-jar-with-dependencies.jar

Building the connector yourself

Alternatively, you can build the connector yourself. To do this, you'll need to first clone this repository and then build through Maven using mvn clean install. After building, the connector is available as:

distribution/target/egeria-connector-hadoop-ecosystem-package-VERSION-jar-with-dependencies.jar

Configure security

There are multiple options to configure the security of your environment for this connector, but this must be done prior to starting up the connector itself (step below).

For simple tests, if you can run your Apache Atlas environment with only its most basic security and without HTTPS, then there is nothing additional you need to configure for the connector.

Alternatively, if you can still use basic authentication (username and password) but must run Apache Atlas via HTTPS, and you simply want to test things out, the simplest (but most insecure) option is to set the environment variable STRICT_SSL to false using something like the following prior to starting up the OMAG Server Platform:

export STRICT_SSL=false

Note that this will disable all certificate validation for SSL connections made between Egeria and your Apache Atlas environment, so is inherently insecure.

Note that in any case, having a truststore.p12 file available to the server chassis is required -- the simplest is to ensure that Egeria's own (https://github.com/odpi/egeria/blob/master/truststore.p12) is placed in the directory in which you are running the server chassis.

Startup the OMAG Server Platform

You can startup the OMAG Server Platform with this connector ready-to-be-configured by running:

$ java -Dloader.path=/lib -jar server-chassis-spring-VERSION.jar

(This command will startup the OMAG Server Platform, including all libraries in the /lib directory as part of the classpath of the OMAG Server Platform.)

Configure the connector(s) you want to use

See the detailed instructions for configuring the connector(s) you want to use:

• Apache Atlas
• Apache Ranger (coming soon)

---

License: CC BY 4.0, Copyright Contributors to the ODPi Egeria project.

LF AI & Data (was ODPi: the open ecosystem of big data)

LF AI & Data is an umbrella foundation,artificial intelligence, machine learning, deep learning, and data.

Versions

Version
1.6 Apr 15, 2020
1.5 Mar 6, 2020
1.3 Feb 1, 2020