Huaweicloud DIS Spark Streaming

Huawei Cloud Data Ingestion Service Spark Streaming SDK

License

License

GroupId

GroupId

com.huaweicloud.dis
ArtifactId

ArtifactId

huaweicloud-dis-spark-streaming
Last Version

Last Version

1.2.0
Release Date

Release Date

Type

Type

jar
Description

Description

Huaweicloud DIS Spark Streaming
Huawei Cloud Data Ingestion Service Spark Streaming SDK
Project URL

Project URL

https://www.huaweicloud.com/product/dis.html

Download huaweicloud-dis-spark-streaming

How to add to project

<!-- https://jarcasting.com/artifacts/com.huaweicloud.dis/huaweicloud-dis-spark-streaming/ -->
<dependency>
    <groupId>com.huaweicloud.dis</groupId>
    <artifactId>huaweicloud-dis-spark-streaming</artifactId>
    <version>1.2.0</version>
</dependency>
// https://jarcasting.com/artifacts/com.huaweicloud.dis/huaweicloud-dis-spark-streaming/
implementation 'com.huaweicloud.dis:huaweicloud-dis-spark-streaming:1.2.0'
// https://jarcasting.com/artifacts/com.huaweicloud.dis/huaweicloud-dis-spark-streaming/
implementation ("com.huaweicloud.dis:huaweicloud-dis-spark-streaming:1.2.0")
'com.huaweicloud.dis:huaweicloud-dis-spark-streaming:jar:1.2.0'
<dependency org="com.huaweicloud.dis" name="huaweicloud-dis-spark-streaming" rev="1.2.0">
  <artifact name="huaweicloud-dis-spark-streaming" type="jar" />
</dependency>
@Grapes(
@Grab(group='com.huaweicloud.dis', module='huaweicloud-dis-spark-streaming', version='1.2.0')
)
libraryDependencies += "com.huaweicloud.dis" % "huaweicloud-dis-spark-streaming" % "1.2.0"
[com.huaweicloud.dis/huaweicloud-dis-spark-streaming "1.2.0"]

Dependencies

compile (1)

Group / Artifact Type Version
com.huaweicloud.dis : huaweicloud-dis-kafka-adapter jar 1.2.2

provided (1)

Group / Artifact Type Version
org.apache.spark : spark-streaming_2.11 jar 2.2.0

Project Modules

There are no modules declared in this project.

DIS SDK for SparkStreaming

DIS Spark Streaming is a sdk provided by the Data Access Service (DIS). It can be used to create a DStream to connect to SparkStreaming.

Quick Links:

Getting Started

Requirements

  • JDK 1.8+
  • Scala-sdk-2.11

Install the JDK

The recommended way to use the DIS SDK for SparkStreaming in your project is to consume it from Maven.

Specify the SDK Maven dependency

<dependency>
    <groupId>com.huaweicloud.dis</groupId>
    <artifactId>huaweicloud-dis-spark-streaming_2.11</artifactId>
    <version>1.2.2</version>
    <scope>compile</scope>
</dependency>

Building From Source

Once you check out the code from GitHub, you can build it using Maven:

mvn clean install

License

Apache License 2.0

com.huaweicloud.dis

HUAWEI CLOUD

Versions

Version
1.2.0