com.kotlinnlp:neuraltokenizer

NeuralTokenizer is a very simple to use text tokenizer which uses neural networks from the SimpleDNN library.

License	Apache License, Version 2.0
Categories	Kotlin Languages
GroupId	com.kotlinnlp
ArtifactId	neuraltokenizer
Last Version	0.4.8
Release Date	Jun 16, 2020
Type	jar
Description	com.kotlinnlp:neuraltokenizer NeuralTokenizer is a very simple to use text tokenizer which uses neural networks from the SimpleDNN library.
Project URL	http://github.com/kotlinnlp/neuraltokenizer
Source Code Management	http://github.com/kotlinnlp/neuraltokenizer/tree/master

Download neuraltokenizer

Filename	Size
neuraltokenizer-0.4.8.pom
neuraltokenizer-0.4.8.jar	51 KB
neuraltokenizer-0.4.8-sources.jar	23 KB
neuraltokenizer-0.4.8-javadoc.jar	64 KB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/com.kotlinnlp/neuraltokenizer/ -->
<dependency>
    <groupId>com.kotlinnlp</groupId>
    <artifactId>neuraltokenizer</artifactId>
    <version>0.4.8</version>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/com.kotlinnlp/neuraltokenizer/
implementation 'com.kotlinnlp:neuraltokenizer:0.4.8'

Gradle Kotlin

// https://jarcasting.com/artifacts/com.kotlinnlp/neuraltokenizer/
implementation ("com.kotlinnlp:neuraltokenizer:0.4.8")

Apache Buildr

'com.kotlinnlp:neuraltokenizer:jar:0.4.8'

Apache Ivy

<dependency org="com.kotlinnlp" name="neuraltokenizer" rev="0.4.8">
  <artifact name="neuraltokenizer" type="jar" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='com.kotlinnlp', module='neuraltokenizer', version='0.4.8')
)

Scala SBT

libraryDependencies += "com.kotlinnlp" % "neuraltokenizer" % "0.4.8"

Leiningen

[com.kotlinnlp/neuraltokenizer "0.4.8"]

Dependencies

compile (5)

Group / Artifact	Type	Version
org.jetbrains.kotlin : kotlin-stdlib-jdk8	jar	1.3.31
org.jetbrains.kotlin : kotlin-reflect	jar	1.3.31
com.beust : klaxon	jar	5.2
com.kotlinnlp : simplednn	jar	0.14.0
com.kotlinnlp : linguisticdescription	jar	0.12.2

test (1)

Group / Artifact	Type	Version
org.jetbrains.kotlin : kotlin-test	jar	1.3.31

Project Modules

There are no modules declared in this project.

NeuralTokenizer

NeuralTokenizer is a very simple to use text tokenizer which uses neural networks from the SimpleDNN library.

NeuralTokenizer is part of KotlinNLP.

Getting Started

Import with Maven

<dependency>
    <groupId>com.kotlinnlp</groupId>
    <artifactId>neuraltokenizer</artifactId>
    <version>0.4.8</version>
</dependency>

Examples

Try some examples of usage of NeuralTokenizer running the files in the examples folder.

To run the examples you need datasets of test and training that you can find here

Model Serialization

The neural model is all contained into a single class which provides simple dump() and load() methods to serialize it and afterwards load it.

License

This software is released under the terms of the Mozilla Public License, v. 2.0

Contributions

We greatly appreciate any bug reports and contributions, which can be made by filing an issue or making a pull request through the github page.

Versions

Version
0.4.8 Jun 16, 2020
0.4.7 Dec 13, 2019
0.4.6 May 30, 2019
0.4.5 Apr 1, 2019
0.4.4 Mar 4, 2019
0.4.3 Jan 18, 2019
0.4.2 Oct 8, 2018
0.4.1 Aug 4, 2018
0.4.0 Jul 30, 2018
0.3.1 Jul 25, 2018
0.3.0 Jul 21, 2018
0.2.1 Jun 15, 2018
0.2.0 Jun 13, 2018
0.1.1 May 15, 2018
0.1.0 Jan 8, 2018