SparkDS

A Scala library for defining Data Specification and Validating data against data specification. Data specifications are Spark schemas, data constraints, valid value lists.

License	Apache 2.0 License
GroupId	com.github.sparkds
ArtifactId	sparkds
Last Version	0.0.1-RC-2
Release Date	Feb 25, 2021
Type	jar
Description	SparkDS A Scala library for defining Data Specification and Validating data against data specification. Data specifications are Spark schemas, data constraints, valid value lists.

Download sparkds

Filename	Size
sparkds-0.0.1-RC-2.pom
sparkds-0.0.1-RC-2.jar	61 KB
sparkds-0.0.1-RC-2-sources.jar	17 KB
sparkds-0.0.1-RC-2-javadoc.jar	450 KB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/com.github.sparkds/sparkds/ -->
<dependency>
    <groupId>com.github.sparkds</groupId>
    <artifactId>sparkds</artifactId>
    <version>0.0.1-RC-2</version>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/com.github.sparkds/sparkds/
implementation 'com.github.sparkds:sparkds:0.0.1-RC-2'

Gradle Kotlin

// https://jarcasting.com/artifacts/com.github.sparkds/sparkds/
implementation ("com.github.sparkds:sparkds:0.0.1-RC-2")

Apache Buildr

'com.github.sparkds:sparkds:jar:0.0.1-RC-2'

Apache Ivy

<dependency org="com.github.sparkds" name="sparkds" rev="0.0.1-RC-2">
  <artifact name="sparkds" type="jar" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='com.github.sparkds', module='sparkds', version='0.0.1-RC-2')
)

Scala SBT

libraryDependencies += "com.github.sparkds" % "sparkds" % "0.0.1-RC-2"

Leiningen

[com.github.sparkds/sparkds "0.0.1-RC-2"]

Dependencies

compile (2)

Group / Artifact	Type	Version
org.scala-lang : scala-library	jar	2.11.8
org.scalacheck : scalacheck_2.11	jar	1.15.2

provided (4)

Group / Artifact	Type	Version
org.apache.spark : spark-core_2.11	jar	2.4.4
org.apache.spark : spark-sql_2.11	jar	2.4.4
org.codehaus.jackson : jackson-mapper-asl	jar	1.8.8
commons-codec : commons-codec	jar	1.14

test (3)

Group / Artifact	Type	Version
org.scalatest : scalatest_2.11	jar	3.0.1
org.scalamock : scalamock-scalatest-support_2.11	jar	3.6.0
org.mockito : mockito-scala_2.11	jar	1.7.1

Project Modules

There are no modules declared in this project.

Versions

Version
0.0.1-RC-2 Feb 25, 2021
0.0.1-RC-1 Feb 25, 2021