CLAVIN Lucene 8.4.0

CLAVIN (Cartographic Location And Vicinity INdexer) is an open source software package for geographic entity resolution from text.

License	Apache 2.0
GroupId	io.bigconnect
ArtifactId	clavin
Last Version	2.3.1-8.4.0
Release Date	Dec 15, 2020
Type	jar
Description	CLAVIN Lucene 8.4.0 CLAVIN (Cartographic Location And Vicinity INdexer) is an open source software package for geographic entity resolution from text.
Source Code Management	https://github.com/bigconnect/clavin

Download clavin

Filename	Size
clavin-2.3.1-8.4.0.pom
clavin-2.3.1-8.4.0.jar	11 MB
clavin-2.3.1-8.4.0-test-javadoc.jar	140 KB
clavin-2.3.1-8.4.0-sources.jar	5 MB
clavin-2.3.1-8.4.0-javadoc.jar	335 KB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/io.bigconnect/clavin/ -->
<dependency>
    <groupId>io.bigconnect</groupId>
    <artifactId>clavin</artifactId>
    <version>2.3.1-8.4.0</version>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/io.bigconnect/clavin/
implementation 'io.bigconnect:clavin:2.3.1-8.4.0'

Gradle Kotlin

// https://jarcasting.com/artifacts/io.bigconnect/clavin/
implementation ("io.bigconnect:clavin:2.3.1-8.4.0")

Apache Buildr

'io.bigconnect:clavin:jar:2.3.1-8.4.0'

Apache Ivy

<dependency org="io.bigconnect" name="clavin" rev="2.3.1-8.4.0">
  <artifact name="clavin" type="jar" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='io.bigconnect', module='clavin', version='2.3.1-8.4.0')
)

Scala SBT

libraryDependencies += "io.bigconnect" % "clavin" % "2.3.1-8.4.0"

Leiningen

[io.bigconnect/clavin "2.3.1-8.4.0"]

Dependencies

compile (5)

Group / Artifact	Type	Version
commons-io : commons-io	jar	2.4
commons-cli : commons-cli	jar	1.2
commons-lang : commons-lang	jar	2.5
org.slf4j : slf4j-api	jar	1.7.10
org.apache.opennlp : opennlp-tools	jar	1.5.3

test (2)

Group / Artifact	Type	Version
junit : junit	jar	4.13
org.mockito : mockito-all	jar	1.9.5

Project Modules

There are no modules declared in this project.

BigConnect CLAVIN

CLAVIN (Cartographic Location And Vicinity INdexer) is an open source software package for document geotagging and geoparsing that employs context-based geographic entity resolution. It combines a variety of open source tools with natural language processing techniques to extract location names from unstructured text documents and resolve them against gazetteer records. Importantly, CLAVIN does not simply "look up" location names; rather, it uses intelligent heuristics-based combinatorial optimization in an attempt to identify precisely which "Springfield" (for example) was intended by the author, based on the context of the document. CLAVIN also employs fuzzy search to handle incorrectly-spelled location names, and it recognizes alternative names (e.g., "Ivory Coast" and "Côte d'Ivoire") as referring to the same geographic entity. By enriching text documents with structured geo data, CLAVIN enables hierarchical geospatial search and advanced geospatial analytics on unstructured data.

Changes

This is a modified version of Clavin to work with Lucene 8.4.0

How to build & use CLAVIN:

1. Check out a copy of the source code:

   git clone https://github.com/bigconnect/clavin.git

2. Move into the newly-created CLAVIN directory:

   cd clavin

3. Download the latest version of allCountries.zip gazetteer file from GeoNames.org:

   curl -O http://download.geonames.org/export/dump/allCountries.zip

4. Unzip the GeoNames gazetteer file:

   unzip allCountries.zip

5. Compile the source code:

   mvn compile

6. Create the Lucene Index (this one-time process will take several minutes):

   MAVEN_OPTS="-Xmx4g" mvn exec:java -Dexec.mainClass="com.bericotech.clavin.index.IndexDirectoryBuilder"

7. Run the example program:

   MAVEN_OPTS="-Xmx2g" mvn exec:java -Dexec.mainClass="com.bericotech.clavin.WorkflowDemo"

   If you encounter an error that looks like this:

   ... InvocationTargetException: Java heap space ...

   set the appropriate environmental variable controlling Maven's memory usage, and increase the size with export MAVEN_OPTS=-Xmx4g or similar.

Once that all runs successfully, feel free to modify the CLAVIN source code to suit your needs.

N.B.: Loading the worldwide gazetteer uses a non-trivial amount of memory. When using CLAVIN in your own programs, if you encounter Java heap space errors (like the one described in Step 7), bump up the maximum heap size for your JVM.

• Add a dependency on the CLAVIN project:

<dependency>
   <groupId>io.bigconnect</groupId>
   <artifactId>clavin</artifactId>
   <version>2.3.1</version>
</dependency>

You will still need to build the GeoNames Lucene Index as described in steps 3, 4, and 6 in "How to build & use CLAVIN".

License:

Copyright (C) 2020 MWARE SOLUTIONS SRL

Copyright (C) 2012-2016 Berico Technologies

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

Versions

Version
2.3.1-8.4.0 Dec 15, 2020