lighthouse-testing


License

License

Categories

Categories

Data
GroupId

GroupId

be.dataminded
ArtifactId

ArtifactId

lighthouse-testing_2.11
Last Version

Last Version

0.3.1
Release Date

Release Date

Type

Type

jar
Description

Description

lighthouse-testing
lighthouse-testing
Project URL

Project URL

https://github.com/datamindedbe/lighthouse
Project Organization

Project Organization

be.dataminded
Source Code Management

Source Code Management

https://github.com/datamindedbe/lighthouse

Download lighthouse-testing_2.11

How to add to project

<!-- https://jarcasting.com/artifacts/be.dataminded/lighthouse-testing_2.11/ -->
<dependency>
    <groupId>be.dataminded</groupId>
    <artifactId>lighthouse-testing_2.11</artifactId>
    <version>0.3.1</version>
</dependency>
// https://jarcasting.com/artifacts/be.dataminded/lighthouse-testing_2.11/
implementation 'be.dataminded:lighthouse-testing_2.11:0.3.1'
// https://jarcasting.com/artifacts/be.dataminded/lighthouse-testing_2.11/
implementation ("be.dataminded:lighthouse-testing_2.11:0.3.1")
'be.dataminded:lighthouse-testing_2.11:jar:0.3.1'
<dependency org="be.dataminded" name="lighthouse-testing_2.11" rev="0.3.1">
  <artifact name="lighthouse-testing_2.11" type="jar" />
</dependency>
@Grapes(
@Grab(group='be.dataminded', module='lighthouse-testing_2.11', version='0.3.1')
)
libraryDependencies += "be.dataminded" % "lighthouse-testing_2.11" % "0.3.1"
[be.dataminded/lighthouse-testing_2.11 "0.3.1"]

Dependencies

compile (3)

Group / Artifact Type Version
org.scala-lang : scala-library jar 2.11.12
org.scalatest : scalatest_2.11 jar 3.1.2
com.github.pathikrit : better-files_2.11 jar 3.8.0

provided (2)

Group / Artifact Type Version
org.apache.spark : spark-sql_2.11 jar 2.4.5
org.apache.spark : spark-hive_2.11 jar 2.4.5

Project Modules

There are no modules declared in this project.

Lighthouse

Maven Central CircleCI Codacy Badge

Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines and apply best practices.

Principles

  • Configuration as code
  • Idempotent execution
  • Utilities for easier building and testing Apache Spark based applications

Start using Lighthouse

In your build.sbt, add this:

libraryDependencies += "be.dataminded" %% "lighthouse" % <version>
libraryDependencies += "be.dataminded" %% "lighthouse-testing" % <version> % Test

If you are using Maven, add this to your pom.xml:

<dependency>
    <groupId>be.dataminded</groupId>
    <artifactId>lighthouse_2.11</artifactId>
    <version>[version]</version>
</dependency>
<dependency>
    <groupId>be.dataminded</groupId>
    <artifactId>lighthouse-testing_2.11</artifactId>
    <version>[version]</version>
    <scope>test</scope>
</dependency>

Online Documentation

This README file only contains basic instructions. Here is a more complete tutorial: https://datamindedbe.github.io/lighthouse/tutorial/

be.dataminded

Data Minded

Versions

Version
0.3.1
0.3.0
0.2.6
0.2.5
0.2.3
0.2.2
0.2.1
0.2.0
0.1.0
0.0.1