Apache Bahir - Spark SQL Cloudant DataSource

The Apache Software Foundation provides support for the Apache community of open-source software projects. The Apache projects are characterized by a collaborative, consensus based development process, an open and pragmatic software license, and a desire to create high quality software that leads the way in its field. We consider ourselves not simply a group of projects sharing a server, but rather a community of developers and users.

License	Apache 2.0 License
Categories	Ant Build Tools
GroupId	org.apache.bahir
ArtifactId	spark-sql-cloudant_2.11
Last Version	2.4.0
Release Date	Sep 13, 2019
Type	jar
Description	Apache Bahir - Spark SQL Cloudant DataSource The Apache Software Foundation provides support for the Apache community of open-source software projects. The Apache projects are characterized by a collaborative, consensus based development process, an open and pragmatic software license, and a desire to create high quality software that leads the way in its field. We consider ourselves not simply a group of projects sharing a server, but rather a community of developers and users.
Project URL	http://bahir.apache.org/
Project Organization	The Apache Software Foundation

Download spark-sql-cloudant_2.11

Filename	Size
spark-sql-cloudant_2.11-2.4.0.pom
spark-sql-cloudant_2.11-2.4.0.jar	140 KB
spark-sql-cloudant_2.11-2.4.0-tests.jar	152 KB
spark-sql-cloudant_2.11-2.4.0-test-sources.jar	40 KB
spark-sql-cloudant_2.11-2.4.0-sources.jar	37 KB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/org.apache.bahir/spark-sql-cloudant_2.11/ -->
<dependency>
    <groupId>org.apache.bahir</groupId>
    <artifactId>spark-sql-cloudant_2.11</artifactId>
    <version>2.4.0</version>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/org.apache.bahir/spark-sql-cloudant_2.11/
implementation 'org.apache.bahir:spark-sql-cloudant_2.11:2.4.0'

Gradle Kotlin

// https://jarcasting.com/artifacts/org.apache.bahir/spark-sql-cloudant_2.11/
implementation ("org.apache.bahir:spark-sql-cloudant_2.11:2.4.0")

Apache Buildr

'org.apache.bahir:spark-sql-cloudant_2.11:jar:2.4.0'

Apache Ivy

<dependency org="org.apache.bahir" name="spark-sql-cloudant_2.11" rev="2.4.0">
  <artifact name="spark-sql-cloudant_2.11" type="jar" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='org.apache.bahir', module='spark-sql-cloudant_2.11', version='2.4.0')
)

Scala SBT

libraryDependencies += "org.apache.bahir" % "spark-sql-cloudant_2.11" % "2.4.0"

Leiningen

[org.apache.bahir/spark-sql-cloudant_2.11 "2.4.0"]

Dependencies

compile (9)

Group / Artifact	Type	Version
org.apache.bahir : bahir-common_2.11	jar	2.4.0
com.cloudant : cloudant-client	jar	2.17.0
com.squareup.okhttp3 : okhttp	jar	3.12.2
com.typesafe : config	jar	1.3.1
org.scalaj : scalaj-http_2.11	jar	2.3.0
org.apache.spark : spark-tags_2.11	jar	2.4.0
org.apache.spark : spark-streaming_2.11	jar	2.4.0
org.apache.spark : spark-sql_2.11	jar	2.4.0
org.spark-project.spark : unused	jar	1.0.0

test (7)

Group / Artifact	Type	Version
org.apache.bahir : bahir-common_2.11	test-jar	2.4.0
org.apache.spark : spark-sql_2.11	test-jar	2.4.0
org.apache.spark : spark-core_2.11	test-jar	2.4.0
org.scalacheck : scalacheck_2.11	jar	1.13.5
org.scalatest : scalatest_2.11	jar	3.0.3
junit : junit	jar	4.12
com.thoughtworks.paranamer : paranamer	jar	2.8

Project Modules

There are no modules declared in this project.

Apache Bahir

Apache Bahir provides extensions to distributed analytics platforms such as Apache Spark & Apache Flink.

http://bahir.apache.org/

Apache Bahir origins

The Initial Bahir source code (see issue BAHIR-1) containing the source for the Apache Spark streaming connectors for akka, mqtt, twitter, zeromq extracted from Apache Spark revision 8301fad (before the deletion of the streaming connectors akka, mqtt, twitter, zeromq).

Source code structure

Source code folder structure:

- streaming-akka
  - examples/src/main/...
  - src/main/...
- streaming-mqtt
  - examples
  - src
  - python
- ...

Building Bahir

Bahir is built using Apache Maven. To build Bahir and its example programs, run:

mvn -DskipTests clean install

Running tests

Testing first requires building Bahir. Once Bahir is built, tests can be run using:

mvn test

Example programs

Each extension currently available in Apache Bahir has an example application located under the "examples" folder.

Documentation

Currently, each submodule has its own README.md, with information on example usages and API.

• SQL Cloudant
• SQL Streaming Akka
• SQL Streaming JDBC
• SQL Streaming MQTT
• SQL Streaming SQS
• Streaming Akka
• Streaming MQTT
• Streaming PubNub
• Streaming Google Pub/Sub
• Streaming Twitter
• Streaming ZeroMQ

Furthermore, to generate scaladocs for each module:

$ mvn package

Scaladocs is generated in, MODULE_NAME/target/site/scaladocs/index.html. __ Where MODULE_NAME is one of, sql-streaming-mqtt, streaming-akka, streaming-mqtt, streaming-zeromq, streaming-twitter. __

A note about Apache Spark integration

Currently, each module in Bahir is available through spark packages. Please follow linking sub section in module specific README.md for more details.

The Apache Software Foundation

Versions

Version
2.4.0 Sep 13, 2019
2.3.4 Sep 11, 2019
2.3.3 May 19, 2019
2.3.2 Nov 30, 2018
2.3.1 Nov 30, 2018
2.3.0 Nov 30, 2018
2.2.3 May 19, 2019
2.2.2 Nov 8, 2018
2.2.1 Jun 6, 2018
2.2.0 Aug 17, 2017
2.1.3 Nov 8, 2018
2.1.2 Jun 1, 2018
2.1.1 Jun 8, 2017