DJL NLP utilities for Huggingface tokenizers

Deep Java Library (DJL) NLP utilities for Huggingface tokenizers

License	The Apache License, Version 2.0
Categories	DJL Business Logic Libraries Machine Learning
GroupId	ai.djl.huggingface
ArtifactId	tokenizers
Last Version	0.17.0
Release Date	May 11, 2022
Type	jar
Description	DJL NLP utilities for Huggingface tokenizers Deep Java Library (DJL) NLP utilities for Huggingface tokenizers
Project URL	http://www.djl.ai/extensions/tokenizers
Source Code Management	https://github.com/deepjavalibrary/djl

Download tokenizers

Filename	Size
tokenizers-0.17.0.pom
tokenizers-0.17.0.jar	15 MB
tokenizers-0.17.0-sources.jar	7 KB
tokenizers-0.17.0-javadoc.jar	35 KB

How to add to project

Apache Maven

<!-- https://jarcasting.com/artifacts/ai.djl.huggingface/tokenizers/ -->
<dependency>
    <groupId>ai.djl.huggingface</groupId>
    <artifactId>tokenizers</artifactId>
    <version>0.17.0</version>
</dependency>

Gradle Groovy

// https://jarcasting.com/artifacts/ai.djl.huggingface/tokenizers/
implementation 'ai.djl.huggingface:tokenizers:0.17.0'

Gradle Kotlin

// https://jarcasting.com/artifacts/ai.djl.huggingface/tokenizers/
implementation ("ai.djl.huggingface:tokenizers:0.17.0")

Apache Buildr

'ai.djl.huggingface:tokenizers:jar:0.17.0'

Apache Ivy

<dependency org="ai.djl.huggingface" name="tokenizers" rev="0.17.0">
  <artifact name="tokenizers" type="jar" />
</dependency>

Groovy Grape

@Grapes(
@Grab(group='ai.djl.huggingface', module='tokenizers', version='0.17.0')
)

Scala SBT

libraryDependencies += "ai.djl.huggingface" % "tokenizers" % "0.17.0"

Leiningen

[ai.djl.huggingface/tokenizers "0.17.0"]

Dependencies

compile (1)

Group / Artifact	Type	Version
ai.djl : api	jar	0.17.0

Project Modules

There are no modules declared in this project.

Versions

Version
0.17.0 May 11, 2022
0.16.0 Mar 20, 2022
0.15.0 Jan 18, 2022