JarCasting
JarCasting JarCasting

com.stratio.connector:connector-commons-core

The commons connector core

License

License
GroupId

GroupId

com.stratio.connector
ArtifactId

ArtifactId

connector-commons-core
Last Version

Last Version

0.2.0
Release Date

Release Date
Type

Type

jar
Description

Description

The commons connector core
Project URL

Project URL

http://www.stratio.com/connector-commons-core

Download connector-commons-core

Filename Size
connector-commons-core-0.2.0.pom
connector-commons-core-0.2.0.jar 23 KB
connector-commons-core-0.2.0-sources.jar 19 KB
connector-commons-core-0.2.0-javadoc.jar 120 KB
Browse

How to add to project

<!-- https://jarcasting.com/artifacts/com.stratio.connector/connector-commons-core/ -->
<dependency>
    <groupId>com.stratio.connector</groupId>
    <artifactId>connector-commons-core</artifactId>
    <version>0.2.0</version>
</dependency>
// https://jarcasting.com/artifacts/com.stratio.connector/connector-commons-core/
implementation 'com.stratio.connector:connector-commons-core:0.2.0'
// https://jarcasting.com/artifacts/com.stratio.connector/connector-commons-core/
implementation ("com.stratio.connector:connector-commons-core:0.2.0")
'com.stratio.connector:connector-commons-core:jar:0.2.0'
<dependency org="com.stratio.connector" name="connector-commons-core" rev="0.2.0">
  <artifact name="connector-commons-core" type="jar" />
</dependency>
@Grapes(
@Grab(group='com.stratio.connector', module='connector-commons-core', version='0.2.0')
)
libraryDependencies += "com.stratio.connector" % "connector-commons-core" % "0.2.0"
[com.stratio.connector/connector-commons-core "0.2.0"]

Dependencies

compile (2)

Group / Artifact Type Version
com.stratio.crossdata : crossdata-common jar 0.1.1
org.slf4j : slf4j-log4j12 jar 1.7.7

test (3)

Group / Artifact Type Version
junit : junit jar 4.11
org.powermock : powermock-api-mockito jar 1.5.5
org.powermock : powermock-module-junit4 jar 1.5.5

Project Modules

There are no modules declared in this project.

This project has been discontinued in favour of Stratio Crossdata, which is a data federation system leveraging Apache Spark capabilities.

About

Stratio Connector Commons provides the classes shared by Stratio connectors.

Main features

User friendly API

This API consists on a set of abstract classes that provides common work related to Stratio connectors. It manages the existing connections and relevant jobs. For instance, when a query is executed, a new job is started. Thus, if the user closes the connector using close(), the connector waits until the pending jobs are done to finish. Furthermore, this module offers a simpler API to develop connectors.

  • CommonsConnector: implements IConnector Crossdata interface.
  • CommonsMetadataEngine: implements IMetadataEngine interface.
  • CommonsStorageEngine: implements IMetadataEngine interface.
  • CommonsQueryEngine: implements IMetadataEngine interface.
  • SingleProjectQueryEngine: extends CommonsQueryEngine. It should be used when the connector does not support joins, so there would be only one project.

In order to use these modules, it is necessary to create an implementation of the following classes included in this project:

  • Connection
  • ConnectionHandler: This handler is in charge of the connector connections. It allows to recover, disconnect and store connections. The connection to handle should fulfill the Connection interface.

Usage examples can be found in connectors using this features:

Functional tests

This API includes a set of functional tests that accomplish the main body of Crossdata features. To run these generic tests is needed to:

  • Extend the functional test. It is possible both override or ignore the test which features are not implemented.

  • Implement a ConnectorHelper. Here, the cluster configuration and the database specific properties are defined. Therefore, you could use different implementations to probe the tests with the desired configuration.

The list of functional tests implemented is detailed here.

Utilities

Helper classes for simplifying testing:

  • LogicalWorkflowCreator: use to create LogicalWorkflow
  • CatalogMetadataBuilder: used to create CatalogMetadata
  • TableMetadataBuilder: used to create TableMetadata
  • IndexMetadataBuilder: used to create IndexMetadata

Common processing for dealing with Crossdata structures are included:

  • ManifestUtil: Parses the Connector manifest to extract not only the connector but the datastore name. It should be used to allow different connector names in the configuration.
  • SelectorHelper: Allows the casting of Crossdata Selectors in order to retrieve the proper value.
  • ProjectParsed: Parses and validates the Crossdata logical steps from reading the Project's workflow.
  • ColumnTypeHelper: Allows the casting of an object based on the columntType.
  • ConnectorParser: Parses the raw information related to hosts and ports coming from Crossdata to the format required by the connector.

License

Licensed to STRATIO (C) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The STRATIO (C) licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

com.stratio.connector

STRATIO BIG DATA Inc.

Drive Digital Transformation through Big Data and AI with a unique product

Versions

Version
0.2.0
0.1.0