edu.emory.mathcs.nlp:nlp4j-morphology

Sonatype helps open source projects to set up Maven repositories on https://oss.sonatype.org/

License

License

GroupId

GroupId

edu.emory.mathcs.nlp
ArtifactId

ArtifactId

nlp4j-morphology
Last Version

Last Version

1.1.2
Release Date

Release Date

Type

Type

jar
Description

Description

Sonatype helps open source projects to set up Maven repositories on https://oss.sonatype.org/
Project URL

Project URL

http://nlp.mathcs.emory.edu
Source Code Management

Source Code Management

https://github.com/emorynlp/nlp4j-morphology

Download nlp4j-morphology

How to add to project

<!-- https://jarcasting.com/artifacts/edu.emory.mathcs.nlp/nlp4j-morphology/ -->
<dependency>
    <groupId>edu.emory.mathcs.nlp</groupId>
    <artifactId>nlp4j-morphology</artifactId>
    <version>1.1.2</version>
</dependency>
// https://jarcasting.com/artifacts/edu.emory.mathcs.nlp/nlp4j-morphology/
implementation 'edu.emory.mathcs.nlp:nlp4j-morphology:1.1.2'
// https://jarcasting.com/artifacts/edu.emory.mathcs.nlp/nlp4j-morphology/
implementation ("edu.emory.mathcs.nlp:nlp4j-morphology:1.1.2")
'edu.emory.mathcs.nlp:nlp4j-morphology:jar:1.1.2'
<dependency org="edu.emory.mathcs.nlp" name="nlp4j-morphology" rev="1.1.2">
  <artifact name="nlp4j-morphology" type="jar" />
</dependency>
@Grapes(
@Grab(group='edu.emory.mathcs.nlp', module='nlp4j-morphology', version='1.1.2')
)
libraryDependencies += "edu.emory.mathcs.nlp" % "nlp4j-morphology" % "1.1.2"
[edu.emory.mathcs.nlp/nlp4j-morphology "1.1.2"]

Dependencies

compile (1)

Group / Artifact Type Version
edu.emory.mathcs.nlp : nlp4j-common jar 1.1.2

test (1)

Group / Artifact Type Version
junit : junit jar 4.10

Project Modules

There are no modules declared in this project.

Morphological Analysis

Our morphological analyzer generates root forms (lemmas) of word tokens. It is a rule-based analyzer inspired by the WordNet morphy although it uses a larger dictionary gathered from various sources and more advanced heuristics. It also normalizes numbers, redundant punctuation, hyperlinks, etc (see the examples below), which is found to be useful for several NLP tasks (see toSimplifiedForm).

Normalization

Ordinals and cardinals are normalized to #ord# and #crd#, respectively.

1st         CD    #ord#
12nd        CD    #ord#
23rd        CD    #ord#
34th        CD    #ord#
first       CD    #ord#
third       CD    #ord#
fourth      CD    #ord#
zero        CD    #crd#
ten         CD    #crd#
eleven      CD    #crd#
fourteen    CD    #crd#

Numeric expressions are normalized to 0.

10%                    XX    0
$10                    XX    0
A.01                   XX    a.0
A:01                   XX    a:0
A/01                   XX    a/0
.01                    XX    0
12.34                  XX    0
12,34,56               XX    0
12-34-56               XX    0
12/34/46               XX    0
$10.23,45:67-89/10%    XX    0

Redundant punctuation characters are collapsed.

.!?-*=~,                                                    XX    .!?-*=~,
..!!??--**==~~,,                                            XX    ..!!??--**==~~,,
...!!!???---***===[[user:jdchoi77]],,,                      XX    ..!!??--**==~~,,
....!!!!????----****====[[user:jdchoi77|1384441338]],,,,    XX    ..!!??--**==~~,,

Hyperlinks are normalized to #hlink#.

http://www.google.com         XX    #hlink#
www.google.com                XX    #hlink#
mailto:[email protected]    XX    #hlink#
some-body@google+.com         XX    #hlink#

API

EnglishLemmatizerTest shows how the anlayzer can be used in APIs.

edu.emory.mathcs.nlp

Emory NLP

NLP research group at Emory University

Versions

Version
1.1.2
1.1.1
1.1.0
1.0.0