elasticsearch-river-dynamodb

DynamoDB River for ElasticSearch

License	The Apache Software License, Version 2.0
Categories	Search Business Logic Libraries Elasticsearch
GroupId	com.github.kzwang
ArtifactId	elasticsearch-river-dynamodb
Last Version	1.0.0
Release Date	Feb 13, 2014
Type	jar
Description	elasticsearch-river-dynamodb DynamoDB River for ElasticSearch
Project URL	http://github.com/kzwang/elasticsearch-river-dynamodb
Source Code Management	http://github.com/kzwang/elasticsearch-river-dynamodb

Download elasticsearch-river-dynamodb

Filename	Size
elasticsearch-river-dynamodb-1.0.0.pom
elasticsearch-river-dynamodb-1.0.0.zip	11 MB
elasticsearch-river-dynamodb-1.0.0-sources.jar	5 KB
elasticsearch-river-dynamodb-1.0.0-javadoc.jar	51 KB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/com.github.kzwang/elasticsearch-river-dynamodb/ -->
<dependency>
    <groupId>com.github.kzwang</groupId>
    <artifactId>elasticsearch-river-dynamodb</artifactId>
    <version>1.0.0</version>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/com.github.kzwang/elasticsearch-river-dynamodb/
implementation 'com.github.kzwang:elasticsearch-river-dynamodb:1.0.0'

Gradle Kotlin

// https://jarcasting.com/artifacts/com.github.kzwang/elasticsearch-river-dynamodb/
implementation ("com.github.kzwang:elasticsearch-river-dynamodb:1.0.0")

Apache Buildr

'com.github.kzwang:elasticsearch-river-dynamodb:jar:1.0.0'

Apache Ivy

<dependency org="com.github.kzwang" name="elasticsearch-river-dynamodb" rev="1.0.0">
  <artifact name="elasticsearch-river-dynamodb" type="jar" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='com.github.kzwang', module='elasticsearch-river-dynamodb', version='1.0.0')
)

Scala SBT

libraryDependencies += "com.github.kzwang" % "elasticsearch-river-dynamodb" % "1.0.0"

Leiningen

[com.github.kzwang/elasticsearch-river-dynamodb "1.0.0"]

Dependencies

compile (2)

Group / Artifact	Type	Version
org.elasticsearch : elasticsearch	jar	1.0.0
com.amazonaws : aws-java-sdk	jar	1.7.1

test (4)

Group / Artifact	Type	Version
org.apache.lucene : lucene-test-framework	jar	4.6.1
log4j : log4j	jar	1.2.17
org.elasticsearch : elasticsearch	test-jar	1.0.0
org.hamcrest : hamcrest-all	jar	1.3

Project Modules

There are no modules declared in this project.

DynamoDB River Plugin for Elasticsearch

The DynamoDB River plugin allows to fetch data from DynamoDB and indexing into Elasticsearch

In order to install the plugin, simply run: bin/plugin -install com.github.kzwang/elasticsearch-river-dynamodb/1.0.0.

DynamoDB Plugin	elasticsearch	Release date
1.1.0-SNAPSHOT (master)	1.0.0.RC2
1.0.0	1.0.0	2014-02-13
1.0.0.RC1	1.0.0.RC2	2014-02-10

Create River

curl -XPUT 'localhost:9200/_river/dynamodb_test/_meta' -d '{
    "type" : "dynamodb",
    "dynamodb" : {
        "access_key" : "YOUR AWS ACCESS KEY",
        "secret_key" : "YOUT AWS SECRET KEY",
        "table_name" : "testdb",
        "id_field" : "my_id",
        "interval" : "5s",
        "updated_timestamp_field" : "updated",
        "deleted_timestamp_field" : "deleted"
    }
}'

Settings

Setting	Description
access_key	AWS access key Mandatory
secret_key	AWS secret key Mandatory
table_name	Table name in DynamoDB for index Mandatory
region	AWS regoin for the DynamoDB. Defaults to us-west-2
index	Index name in Elasticsearch. Defaults to same as table_name
type	Type name in Elasticsearch. Defaults to same as table_name
interval	Index interval, set to 0s to index once only. Default to 0s
bulk_size	Bulk size for fetching from DynamoDB and index in to Elasticsearch. Defaults to 100
id_field	Field name in DynamoDB for the id field. Defaults to id
updated_timestamp_field	Field name in DynamoDB of item updated timestamp
deleted_timestamp_field	Field name in DynamoDB of item deleted timestamp

Updated Timestamp Field

Name of the field which contains the timestamp of when the item updated. This is mandatory if you want only index new items since last index.

Deleted Timestamp Field

Name of the field which contains the timestamp of when the item deleted. This is mandatory if you want DynamoDB river automatically delete items in the index.

Versions

Version
1.0.0 Feb 13, 2014
1.0.0.RC1 Feb 10, 2014