lighthouse-testing

License	Apache-2.0
Categories	Data
GroupId	be.dataminded
ArtifactId	lighthouse-testing_2.11
Last Version	0.3.1
Release Date	Aug 21, 2020
Type	jar
Description	lighthouse-testing lighthouse-testing
Project URL	https://github.com/datamindedbe/lighthouse
Project Organization	be.dataminded
Source Code Management	https://github.com/datamindedbe/lighthouse

Download lighthouse-testing_2.11

Filename	Size
lighthouse-testing_2.11-0.3.1.pom
lighthouse-testing_2.11-0.3.1.jar	43 KB
lighthouse-testing_2.11-0.3.1-sources.jar	5 KB
lighthouse-testing_2.11-0.3.1-javadoc.jar	385 KB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/be.dataminded/lighthouse-testing_2.11/ -->
<dependency>
    <groupId>be.dataminded</groupId>
    <artifactId>lighthouse-testing_2.11</artifactId>
    <version>0.3.1</version>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/be.dataminded/lighthouse-testing_2.11/
implementation 'be.dataminded:lighthouse-testing_2.11:0.3.1'

Gradle Kotlin

// https://jarcasting.com/artifacts/be.dataminded/lighthouse-testing_2.11/
implementation ("be.dataminded:lighthouse-testing_2.11:0.3.1")

Apache Buildr

'be.dataminded:lighthouse-testing_2.11:jar:0.3.1'

Apache Ivy

<dependency org="be.dataminded" name="lighthouse-testing_2.11" rev="0.3.1">
  <artifact name="lighthouse-testing_2.11" type="jar" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='be.dataminded', module='lighthouse-testing_2.11', version='0.3.1')
)

Scala SBT

libraryDependencies += "be.dataminded" % "lighthouse-testing_2.11" % "0.3.1"

Leiningen

[be.dataminded/lighthouse-testing_2.11 "0.3.1"]

Dependencies

compile (3)

Group / Artifact	Type	Version
org.scala-lang : scala-library	jar	2.11.12
org.scalatest : scalatest_2.11	jar	3.1.2
com.github.pathikrit : better-files_2.11	jar	3.8.0

provided (2)

Group / Artifact	Type	Version
org.apache.spark : spark-sql_2.11	jar	2.4.5
org.apache.spark : spark-hive_2.11	jar	2.4.5

Project Modules

There are no modules declared in this project.

Lighthouse

Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines and apply best practices.

Principles

• Configuration as code
• Idempotent execution
• Utilities for easier building and testing Apache Spark based applications

Start using Lighthouse

In your build.sbt, add this:

libraryDependencies += "be.dataminded" %% "lighthouse" % <version>
libraryDependencies += "be.dataminded" %% "lighthouse-testing" % <version> % Test

If you are using Maven, add this to your pom.xml:

<dependency>
    <groupId>be.dataminded</groupId>
    <artifactId>lighthouse_2.11</artifactId>
    <version>[version]</version>
</dependency>
<dependency>
    <groupId>be.dataminded</groupId>
    <artifactId>lighthouse-testing_2.11</artifactId>
    <version>[version]</version>
    <scope>test</scope>
</dependency>

Online Documentation

This README file only contains basic instructions. Here is a more complete tutorial: https://datamindedbe.github.io/lighthouse/tutorial/

Data Minded

Versions

Version
0.3.1 Aug 21, 2020
0.3.0 Feb 2, 2020
0.2.6 Feb 1, 2019
0.2.5 Sep 11, 2018
0.2.3 Jul 26, 2018
0.2.2 May 3, 2018
0.2.1 Mar 13, 2018
0.2.0 Feb 24, 2018
0.1.0 Feb 9, 2018
0.0.1 Feb 9, 2018