Nessie - Versioned - MongoDB

Data Ops for Data Lakes

License	The Apache License, Version 2.0
Categories	MongoDB Data Databases
GroupId	org.projectnessie
ArtifactId	nessie-versioned-mongodb
Last Version	0.3.0
Release Date	Dec 31, 2020
Type	jar
Description	Nessie - Versioned - MongoDB Data Ops for Data Lakes
Project Organization	Project Nessie

Download nessie-versioned-mongodb

Filename	Size
nessie-versioned-mongodb-0.3.0.pom
nessie-versioned-mongodb-0.3.0.jar	31 KB
nessie-versioned-mongodb-0.3.0-tests.jar	12 KB
nessie-versioned-mongodb-0.3.0-sources.jar	13 KB
nessie-versioned-mongodb-0.3.0-javadoc.jar	411 KB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/org.projectnessie/nessie-versioned-mongodb/ -->
<dependency>
    <groupId>org.projectnessie</groupId>
    <artifactId>nessie-versioned-mongodb</artifactId>
    <version>0.3.0</version>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/org.projectnessie/nessie-versioned-mongodb/
implementation 'org.projectnessie:nessie-versioned-mongodb:0.3.0'

Gradle Kotlin

// https://jarcasting.com/artifacts/org.projectnessie/nessie-versioned-mongodb/
implementation ("org.projectnessie:nessie-versioned-mongodb:0.3.0")

Apache Buildr

'org.projectnessie:nessie-versioned-mongodb:jar:0.3.0'

Apache Ivy

<dependency org="org.projectnessie" name="nessie-versioned-mongodb" rev="0.3.0">
  <artifact name="nessie-versioned-mongodb" type="jar" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='org.projectnessie', module='nessie-versioned-mongodb', version='0.3.0')
)

Scala SBT

libraryDependencies += "org.projectnessie" % "nessie-versioned-mongodb" % "0.3.0"

Leiningen

[org.projectnessie/nessie-versioned-mongodb "0.3.0"]

Dependencies

compile (4)

Group / Artifact	Type	Version
org.projectnessie : nessie-versioned-tiered	jar	0.3.0
org.projectnessie : nessie-versioned-spi	jar	0.3.0
org.mongodb : mongodb-driver-reactivestreams	jar	4.1.1
org.mongodb : bson	jar	4.1.1

provided (1)

Group / Artifact	Type	Version
org.immutables : value	jar	2.8.9-ea-1

test (5)

Group / Artifact	Type	Version
org.projectnessie : nessie-versioned-tiered-tests	jar	0.3.0
org.junit.jupiter : junit-jupiter-api	jar
ch.qos.logback : logback-classic	jar	1.2.3
ch.qos.logback : logback-core	jar	1.2.3
de.flapdoodle.embed : de.flapdoodle.embed.mongo	jar	3.0.0

Project Modules

There are no modules declared in this project.

Project Nessie

Project Nessie is a system to provide Git like capability for Iceberg Tables, Delta Lake Tables, Hive Tables and Sql Views.

More information can be found at projectnessie.org.

Using Nessie

You can quickly get started with Nessie by using our small, fast docker image.

docker pull projectnessie/nessie
docker run -p 19120:19120 projectnessie/nessie

Then install the Nessie CLI tool

pip install pynessie

From there, you can use one of our technology integrations such those for

• Spark
• Hive

Have fun! We have a Google Group and a Slack channel we use for both developers and users. Check them out here.

Building and Developing Nessie

Requirements

• JDK 11 or higher: JDK11 or higher is needed to build Nessie (artifacts are built for with Java 8)

Installation

Clone this repository and run maven:

git clone https://github.com/projectnessie/nessie
cd nessie
./mvnw clean install

Delta Lake artifacts

Nessie required some minor changes to Delta for full support of branching and history. These changes are currently being integrated into the mainline repo. Until these have been merged we have provided custom builds in our fork which can be downloaded from a separate maven repository.

Distribution

To run:

1. configuration in servers/quarkus-server/src/main/resources/application.properties
2. execute ./mvnw quarkus:dev
3. go to http://localhost:19120

UI

To run the ui (from ui directory):

1. If you are running in test ensure that setupProxy.js points to the correct api instance. This ensures we avoid CORS issues in testing
2. npm install will install dependencies
3. npm run start to start the ui in development mode via node

To deploy the ui (from ui directory):

1. npm install will install dependencies
2. npm build will minify and collect the package for deployment in build
3. the build directory can be deployed to any static hosting environment or run locally as serve -s build

Docker image

When running mvn clean install a docker image will be created at projectnessie/nessie which can be started with docker run -p 19120:19120 projectnessie/nessie and the relevant environment variables. Environment variables are specified as per https://github.com/eclipse/microprofile-config/blob/master/spec/src/main/asciidoc/configsources.asciidoc#default-configsources

AWS Lambda

You can also deploy to AWS lambda function by following the steps in servers/lambda/README.md

Project Nessie

Versions

Version
0.3.0 Dec 31, 2020