quasar-datasource-azure
Usage
libraryDependencies += "com.precog" %% "quasar-datasource-azure" % <version>
Configuration
Configuration for the Azure datasource has the following JSON format
{
"container": String,
"storageUrl": String,
"format": {
"type": "json" | "separated-values"
// for "json"
"precise": Boolean,
"variant" "array-wrapped" | "line-delimited"
// for "separated-values", all strings must be one symbol length
"header": Boolean,
// The first char of row break
"row1": String,
// The second char of row break, empty string if row break has only one symbol
"row2": String,
// Column separator (char)
"record": String,
"openQuote": String,
"closeQuote": String,
"escape": String
},
["credentials": Object,]
["maxQueueSize": Number]
}
container
the name of the Azure blobstore container to use.storageUrl
the Azure storage URL to use. Typically this will be an URL of the formhttps://<accountName>.blob.core.windows.net/
.format
the format of the resource referred to byurl
. CSV/TSV, array wrapped json and line delimited jsons are supportedcredentials
(optional, default = empty) Azure credentials to use for access. Object has the following format:{ "accountName": String, "accountKey": String }
.maxQueueSize
(optional, default = 10) maximum amount ofByteBuffer
s that can be kept in a queue when downloading a resource. When the queue is full, downloading will halt. Downloading will continue again when aByteBuffer
is dequeued. Usually this value does not need to be overridden, but it can be increased in case downloading halts too often, or decreased to reduce memory use.