JarCasting
JarCasting JarCasting

Deep Connector

Deep connector for multiple data sources

License

License
GroupId

GroupId

com.stratio.connector
ArtifactId

ArtifactId

stratio-connector-deep
Last Version

Last Version

0.1.0
Release Date

Release Date
Type

Type

jar
Description

Description

Deep Connector
Deep connector for multiple data sources
Project URL

Project URL

http://www.stratio.com
Source Code Management

Source Code Management

https://github.com/Stratio/stratio-connector-deep

Download stratio-connector-deep

Filename Size
stratio-connector-deep-0.1.0.pom
stratio-connector-deep-0.1.0.jar 57 KB
stratio-connector-deep-0.1.0-sources.jar 48 KB
stratio-connector-deep-0.1.0-javadoc.jar 227 KB
Browse

How to add to project

<!-- https://jarcasting.com/artifacts/com.stratio.connector/stratio-connector-deep/ -->
<dependency>
    <groupId>com.stratio.connector</groupId>
    <artifactId>stratio-connector-deep</artifactId>
    <version>0.1.0</version>
</dependency>
// https://jarcasting.com/artifacts/com.stratio.connector/stratio-connector-deep/
implementation 'com.stratio.connector:stratio-connector-deep:0.1.0'
// https://jarcasting.com/artifacts/com.stratio.connector/stratio-connector-deep/
implementation ("com.stratio.connector:stratio-connector-deep:0.1.0")
'com.stratio.connector:stratio-connector-deep:jar:0.1.0'
<dependency org="com.stratio.connector" name="stratio-connector-deep" rev="0.1.0">
  <artifact name="stratio-connector-deep" type="jar" />
</dependency>
@Grapes(
@Grab(group='com.stratio.connector', module='stratio-connector-deep', version='0.1.0')
)
libraryDependencies += "com.stratio.connector" % "stratio-connector-deep" % "0.1.0"
[com.stratio.connector/stratio-connector-deep "0.1.0"]

Dependencies

compile (9)

Group / Artifact Type Version
com.stratio.crossdata : crossdata-connector jar 0.1.0-SNAPSHOT
com.stratio.deep : deep-core jar 0.5.0
com.stratio.deep : deep-cassandra jar 0.5.0
com.stratio.deep : deep-mongodb jar 0.5.0
com.stratio.deep : deep-elasticsearch jar 0.5.0
com.stratio.connector : connector-commons-core jar 0.4.0
log4j : log4j jar 1.2.17
org.slf4j : slf4j-log4j12 jar 1.7.7
com.stratio.crossdata : crossdata-common jar 0.1.0

test (3)

Group / Artifact Type Version
junit : junit jar 4.11
org.powermock : powermock-api-mockito jar 1.5.5
org.powermock : powermock-module-junit4 jar 1.5.5

Project Modules

There are no modules declared in this project.

This project has been discontinued in favour of Stratio Crossdata, which is a data federation system leveraging Apache Spark capabilities.

Stratio-Connector-Deep

Deep connector for multiple data sources

Requirements

Stratio Connector deep must be installed and started. [Crossdata] (https://github.com/Stratio/crossdata) is needed to interact with this connector.

Compiling Stratio Connector Deep

To automatically build execute the following command:

   > mvn clean compile install

Build an executable Connector Deep##

To generate the executable execute the following command:

   > mvn crossdata-connector:install

Running the Stratio Connector Deep##

To run Connector Elasticsearch execute:

   > cd connector-deep-core/
   > target/connector-deep-core-0.4.0-SNAPSHOT/bin/connector-deep-core-0.4.0-SNAPSHOT start

To stop the connector execute:

   > target/connector-deep-core-0.4.0-SNAPSHOT/bin/connector-deep-core-0.4.0-SNAPSHOT stop

Build a redistributable package

It is possible too, to create a RPM or DEB redistributable package.

RPM Package:

> mvn unix:package-rpm -N

DEB Package:

> mvn unix:package-deb -N

Once the package it's created, execute this commands to install:

RPM Package:

> rpm -i target/stratio-connector-deep-0.4.0-SNAPSHOT.rpm

DEB Package:

> dpkg -i target/stratio-connector-deep-0.4.0-SNAPSHOT.deb

Now to start/stop the connector:

> service stratio-connector-deep start
> service stratio-connector-deep stop

How to use Deep Connector

  1. Start crossdata-server and then crossdata-shell.

  2. https://github.com/Stratio/crossdata

  3. Start Deep Connector as it is explained before

  4. In crossdata-shell:

    Add a datastore with this command:

       xdsh:user>  ADD DATASTORE <Absolute path to Datastore manifest>;

    Attach cluster on that datastore. The datastore name must be the same as the defined in the Datastore manifest.

       xdsh:user>  ATTACH CLUSTER <cluster_name> ON DATASTORE <datastore_name> WITH OPTIONS {'Hosts': '[<ipHost_1,
   ipHost_2,...ipHost_n>]', 'Port': <hdfs_port> };

    Add the connector manifest.

      xdsh:user>  ADD CONNECTOR <Path to HDFS Connector Manifest>

    Attach the connector to the previously defined cluster. The connector name must match the one defined in the Connector Manifest.

    ```
    xdsh:user>  ATTACH CONNECTOR <connector name> TO <cluster name> WITH OPTIONS {'DefaultLimit': '1000'};
```

    At this point, we can start to send queries.

    ...
    xdsh:user> CREATE CATALOG catalogTest;

    xdsh:user> USE catalogTest;

    xdsh:user> CREATE TABLE tableTest ON CLUSTER datastore_prod (id int PRIMARY KEY, name text);

...

License

Stratio Crossdata is licensed as Apache2

Licensed to STRATIO (C) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The STRATIO (C) licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

com.stratio.connector

STRATIO BIG DATA Inc.

Drive Digital Transformation through Big Data and AI with a unique product

Versions

Version
0.1.0