lighthouse-core

License	Apache-2.0
Categories	Data
GroupId	be.dataminded
ArtifactId	lighthouse-core_2.11
Last Version	0.0.1
Release Date	Feb 9, 2018
Type	jar
Description	lighthouse-core lighthouse-core
Project URL	https://github.com/datamindedbe/lighthouse
Project Organization	be.dataminded
Source Code Management	https://github.com/datamindedbe/lighthouse

Download lighthouse-core_2.11

Filename	Size
lighthouse-core_2.11-0.0.1.pom
lighthouse-core_2.11-0.0.1.jar	162 KB
lighthouse-core_2.11-0.0.1-sources.jar	17 KB
lighthouse-core_2.11-0.0.1-javadoc.jar	537 KB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/be.dataminded/lighthouse-core_2.11/ -->
<dependency>
    <groupId>be.dataminded</groupId>
    <artifactId>lighthouse-core_2.11</artifactId>
    <version>0.0.1</version>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/be.dataminded/lighthouse-core_2.11/
implementation 'be.dataminded:lighthouse-core_2.11:0.0.1'

Gradle Kotlin

// https://jarcasting.com/artifacts/be.dataminded/lighthouse-core_2.11/
implementation ("be.dataminded:lighthouse-core_2.11:0.0.1")

Apache Buildr

'be.dataminded:lighthouse-core_2.11:jar:0.0.1'

Apache Ivy

<dependency org="be.dataminded" name="lighthouse-core_2.11" rev="0.0.1">
  <artifact name="lighthouse-core_2.11" type="jar" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='be.dataminded', module='lighthouse-core_2.11', version='0.0.1')
)

Scala SBT

libraryDependencies += "be.dataminded" % "lighthouse-core_2.11" % "0.0.1"

Leiningen

[be.dataminded/lighthouse-core_2.11 "0.0.1"]

Dependencies

compile (8)

Group / Artifact	Type	Version
org.scala-lang : scala-library	jar	2.11.12
com.github.scopt : scopt_2.11	jar	3.7.0
com.github.pathikrit : better-files_2.11	jar	3.4.0
com.typesafe.scala-logging : scala-logging_2.11	jar	3.7.2
com.amazonaws : aws-java-sdk-s3	jar	1.11.270
com.amazonaws : aws-java-sdk-ssm	jar	1.11.270
org.typelevel : cats-core_2.11	jar	1.0.1
com.typesafe : config	jar	1.3.2

provided (3)

Group / Artifact	Type	Version
org.apache.spark : spark-core_2.11	jar	2.2.1
org.apache.spark : spark-sql_2.11	jar	2.2.1
org.apache.spark : spark-hive_2.11	jar	2.2.1

test (2)

Group / Artifact	Type	Version
be.dataminded : lighthouse-testing_2.11	jar	0.0.1
org.scalatest : scalatest_2.11	jar	3.0.4

Project Modules

There are no modules declared in this project.

Lighthouse

Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines and apply best practices.

Principles

• Configuration as code
• Idempotent execution
• Utilities for easier building and testing Apache Spark based applications

Start using Lighthouse

In your build.sbt, add this:

libraryDependencies += "be.dataminded" %% "lighthouse" % <version>
libraryDependencies += "be.dataminded" %% "lighthouse-testing" % <version> % Test

If you are using Maven, add this to your pom.xml:

<dependency>
    <groupId>be.dataminded</groupId>
    <artifactId>lighthouse_2.11</artifactId>
    <version>[version]</version>
</dependency>
<dependency>
    <groupId>be.dataminded</groupId>
    <artifactId>lighthouse-testing_2.11</artifactId>
    <version>[version]</version>
    <scope>test</scope>
</dependency>

Online Documentation

This README file only contains basic instructions. Here is a more complete tutorial: https://datamindedbe.github.io/lighthouse/tutorial/

Data Minded

Versions

Version
0.0.1 Feb 9, 2018