datalake-core

Library built on top of Apache Spark to speed-up data lakes development..

License	Apache 2
Categories	Data
GroupId	bio.ferlab
ArtifactId	datalake-core_2.12
Last Version	0.0.25
Release Date	May 12, 2021
Type	jar
Description	datalake-core Library built on top of Apache Spark to speed-up data lakes development..
Project URL	https://github.com/Ferlab-Ste-Justine/datalake-lib
Project Organization	ferlab
Source Code Management	https://github.com/Ferlab-Ste-Justine/datalake-lib

Download datalake-core_2.12

Filename	Size
datalake-core_2.12-0.0.25.pom
datalake-core_2.12-0.0.25.jar	191 KB
datalake-core_2.12-0.0.25-sources.jar	19 KB
datalake-core_2.12-0.0.25-javadoc.jar	1 MB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/bio.ferlab/datalake-core_2.12/ -->
<dependency>
    <groupId>bio.ferlab</groupId>
    <artifactId>datalake-core_2.12</artifactId>
    <version>0.0.25</version>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/bio.ferlab/datalake-core_2.12/
implementation 'bio.ferlab:datalake-core_2.12:0.0.25'

Gradle Kotlin

// https://jarcasting.com/artifacts/bio.ferlab/datalake-core_2.12/
implementation ("bio.ferlab:datalake-core_2.12:0.0.25")

Apache Buildr

'bio.ferlab:datalake-core_2.12:jar:0.0.25'

Apache Ivy

<dependency org="bio.ferlab" name="datalake-core_2.12" rev="0.0.25">
  <artifact name="datalake-core_2.12" type="jar" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='bio.ferlab', module='datalake-core_2.12', version='0.0.25')
)

Scala SBT

libraryDependencies += "bio.ferlab" % "datalake-core_2.12" % "0.0.25"

Leiningen

[bio.ferlab/datalake-core_2.12 "0.0.25"]

Dependencies

compile (4)

Group / Artifact	Type	Version
org.scala-lang : scala-library	jar	2.12.13
com.github.pureconfig : pureconfig_2.12	jar	0.14.1
org.typelevel : cats-core_2.12	jar	2.2.0
io.projectglow : glow-spark3_2.12	jar	0.6.0

provided (3)

Group / Artifact	Type	Version
org.apache.spark : spark-core_2.12	jar	3.0.2
org.apache.spark : spark-sql_2.12	jar	3.0.2
io.delta : delta-core_2.12	jar	0.8.0

test (1)

Group / Artifact	Type	Version
org.scalatest : scalatest_2.12	jar	3.2.0

Project Modules

There are no modules declared in this project.

datalake-lib

Library built on top of Apache Spark to speed-up data lakes development.

datalake-spark3

Unit tests requirements

• Java 11

datalake-spark2

Unit tests requirements

• An instance of Elasticsearh 7.8.1+ running on http://localhost:9200
• Java 8

Ferlab Ste-Justine

Centre de Recherche du CHU Sainte-Justine - Dr. Ferretti

Versions

Version
0.0.25 May 12, 2021
0.0.20 May 12, 2021
0.0.15 May 12, 2021
0.0.10 Apr 28, 2021
0.0.9 Mar 22, 2021
0.0.8 Mar 18, 2021
0.0.7 Mar 18, 2021
0.0.5 Mar 18, 2021
0.0.4 Mar 17, 2021
0.0.3 Mar 17, 2021
0.0.2 Mar 12, 2021
0.0.1 Mar 10, 2021