com.cldellow:segmenter

Segment strings into words.

License	Apache License, Version 2.0
GroupId	com.cldellow
ArtifactId	segmenter
Last Version	0.0.3
Release Date	Feb 10, 2019
Type	jar
Description	com.cldellow:segmenter Segment strings into words.
Project URL	https://github.com/cldellow/segmenter
Source Code Management	https://github.com/cldellow/segmenter/tree/master

Download segmenter

Filename	Size
segmenter-0.0.3.pom
segmenter-0.0.3.jar	5 KB
segmenter-0.0.3-sources.jar	5 KB
segmenter-0.0.3-javadoc.jar	27 KB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/com.cldellow/segmenter/ -->
<dependency>
    <groupId>com.cldellow</groupId>
    <artifactId>segmenter</artifactId>
    <version>0.0.3</version>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/com.cldellow/segmenter/
implementation 'com.cldellow:segmenter:0.0.3'

Gradle Kotlin

// https://jarcasting.com/artifacts/com.cldellow/segmenter/
implementation ("com.cldellow:segmenter:0.0.3")

Apache Buildr

'com.cldellow:segmenter:jar:0.0.3'

Apache Ivy

<dependency org="com.cldellow" name="segmenter" rev="0.0.3">
  <artifact name="segmenter" type="jar" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='com.cldellow', module='segmenter', version='0.0.3')
)

Scala SBT

libraryDependencies += "com.cldellow" % "segmenter" % "0.0.3"

Leiningen

[com.cldellow/segmenter "0.0.3"]

Dependencies

compile (1)

Group / Artifact	Type	Version
com.hankcs : aho-corasick-double-array-trie	jar	1.2.1

test (1)

Group / Artifact	Type	Version
junit : junit	jar	4.12

Project Modules

There are no modules declared in this project.

segmenter

Segment short strings into words.

Usage

The easiest way to get started is to create a map of word probabilities:

HashMap<String, Double> probabilities = new HashMap<String, Double>();
probabilities.put("eats", 0.2);
probabilities.put("at", 0.2);
probabilities.put("eat", 0.1);
probabilities.put("sat", 0.1);

Segmenter segmenter = new Segmenter(probabilities);
Result result = segmenter.segment("eatsat", 2, 2, 0);

result.getPhrase(0); // "eats at"
result.getPhrase(1); // "eat sat"

Under the covers, the Segmenter converts the map into a trie. The construction step is slow, so you can also pass a constructed trie (perhaps deserialized from a previous construction) to speed up that step.

The Segmenter class is thread-safe.

Versions

Version
0.0.3 Feb 10, 2019
0.0.2 Jan 13, 2019
0.0.1 Jan 13, 2019