quasar-datasource-azure


License

License

Categories

Categories

Data Quasar Application Layer Libs Distributed Applications
GroupId

GroupId

com.slamdata
ArtifactId

ArtifactId

quasar-datasource-azure_2.12
Last Version

Last Version

2.1.7
Release Date

Release Date

Type

Type

jar
Description

Description

quasar-datasource-azure
quasar-datasource-azure
Project URL

Project URL

https://github.com/slamdata/quasar-datasource-azure
Project Organization

Project Organization

SlamData Inc.
Source Code Management

Source Code Management

https://github.com/slamdata/quasar-datasource-azure

Download quasar-datasource-azure_2.12

How to add to project

<!-- https://jarcasting.com/artifacts/com.slamdata/quasar-datasource-azure_2.12/ -->
<dependency>
    <groupId>com.slamdata</groupId>
    <artifactId>quasar-datasource-azure_2.12</artifactId>
    <version>2.1.7</version>
</dependency>
// https://jarcasting.com/artifacts/com.slamdata/quasar-datasource-azure_2.12/
implementation 'com.slamdata:quasar-datasource-azure_2.12:2.1.7'
// https://jarcasting.com/artifacts/com.slamdata/quasar-datasource-azure_2.12/
implementation ("com.slamdata:quasar-datasource-azure_2.12:2.1.7")
'com.slamdata:quasar-datasource-azure_2.12:jar:2.1.7'
<dependency org="com.slamdata" name="quasar-datasource-azure_2.12" rev="2.1.7">
  <artifact name="quasar-datasource-azure_2.12" type="jar" />
</dependency>
@Grapes(
@Grab(group='com.slamdata', module='quasar-datasource-azure_2.12', version='2.1.7')
)
libraryDependencies += "com.slamdata" % "quasar-datasource-azure_2.12" % "2.1.7"
[com.slamdata/quasar-datasource-azure_2.12 "2.1.7"]

Dependencies

compile (9)

Group / Artifact Type Version
org.scala-lang : scala-library jar 2.12.6
com.codecommit : shims_2.12 jar 1.2.1
com.github.alexarchambault : argonaut-refined_6.2_2.12 jar 1.2.0-M8
com.microsoft.azure : azure-storage-blob jar 10.3.0
eu.timepit : refined-scalacheck_2.12 jar 0.8.5
io.netty : netty-all jar 4.1.28.Final
io.reactivex.rxjava2 : rxjava jar 2.2.2
org.typelevel : cats-effect_2.12 jar 1.0.0
com.slamdata » quasar-connector-internal_2.12 jar 91.0.7

test (6)

Group / Artifact Type Version
com.slamdata » quasar-foundation-internal_2.12 jar 91.0.7
org.slf4j : slf4j-log4j12 jar 1.7.25
org.specs2 : specs2-core_2.12 jar 4.3.3
org.specs2 : specs2-scalaz_2.12 jar 4.3.3
org.specs2 : specs2-scalacheck_2.12 jar 4.3.3
com.slamdata » quasar-connector-internal_2.12 jar 91.0.7

Project Modules

There are no modules declared in this project.

quasar-datasource-azure Discord

Usage

libraryDependencies += "com.precog" %% "quasar-datasource-azure" % <version>

Configuration

Configuration for the Azure datasource has the following JSON format

{
  "container": String,
  "storageUrl": String,
  "format": {
    "type": "json" | "separated-values"
    // for "json"
    "precise": Boolean,
    "variant" "array-wrapped" | "line-delimited"
    // for "separated-values", all strings must be one symbol length
    "header": Boolean,
    // The first char of row break
    "row1": String,
    // The second char of row break, empty string if row break has only one symbol
    "row2": String,
    // Column separator (char)
    "record": String,
    "openQuote": String,
    "closeQuote": String,
    "escape": String
  },
  ["credentials": Object,]
  ["maxQueueSize": Number]
}
  • container the name of the Azure blobstore container to use.
  • storageUrl the Azure storage URL to use. Typically this will be an URL of the form https://<accountName>.blob.core.windows.net/.
  • format the format of the resource referred to by url. CSV/TSV, array wrapped json and line delimited jsons are supported
  • credentials (optional, default = empty) Azure credentials to use for access. Object has the following format: { "accountName": String, "accountKey": String }.
  • maxQueueSize (optional, default = 10) maximum amount of ByteBuffers that can be kept in a queue when downloading a resource. When the queue is full, downloading will halt. Downloading will continue again when a ByteBuffer is dequeued. Usually this value does not need to be overridden, but it can be increased in case downloading halts too often, or decreased to reduce memory use.
com.slamdata

SlamData, Inc.

Versions

Version
2.1.7
2.1.6
2.1.4
2.1.3
2.1.2
2.1.1
2.1.0
2.0.5
2.0.3