Unicode TR39 Table Generator

Maven plugin to generate confusables tables from Unicode TR39

License

License

Categories

Categories

Maven Build Tools
GroupId

GroupId

com.github.mpkorstanje
ArtifactId

ArtifactId

tr39-confusables-table-generator-maven-plugin
Last Version

Last Version

8.0.10
Release Date

Release Date

Type

Type

maven-plugin
Description

Description

Unicode TR39 Table Generator
Maven plugin to generate confusables tables from Unicode TR39

Download tr39-confusables-table-generator-maven-plugin

How to add to project

<plugin>
    <groupId>com.github.mpkorstanje</groupId>
    <artifactId>tr39-confusables-table-generator-maven-plugin</artifactId>
    <version>8.0.10</version>
</plugin>

Dependencies

compile (4)

Group / Artifact Type Version
org.antlr : stringtemplate jar 4.0.2
com.google.guava : guava jar 20.0
org.apache.maven : maven-plugin-api jar 3.3.9
org.apache.maven : maven-project jar 2.2.1

provided (1)

Group / Artifact Type Version
org.apache.maven.plugin-tools : maven-plugin-annotations jar 3.5

Project Modules

There are no modules declared in this project.

tr39-confusables Maven Central Build Status

Skeleton algorithm from Unicode TR39 for testing confusability of strings.

Version 8.0.10 matches version 8.0 draft 10 of TR39

Usage

import static com.github.mpkorstanje.unicode.tr39confusables.Skeleton.skeleton;
...
// Skeleton representations of unicode strings containing 
// confusable characters are equal 
skeleton("paypal").equals(skeleton("paypal")); // true
skeleton("paypal").equals(skeleton("𝔭𝒢ỿ𝕑𝕒ℓ")); // true
skeleton("paypal").equals(skeleton("ΟβΊΡƒπ“…π’‚ΧŸ")); // true
skeleton("ΟβΊΡƒπ“…π’‚ΧŸ").equals(skeleton("𝔭𝒢ỿ𝕑𝕒ℓ")); // true
skeleton("ΟβΊΡƒπ“…π’‚ΧŸ").equals(skeleton("𝔭𝒢ỿ𝕑𝕒ℓ")); // true

// The skeleton representation does not transform case
skeleton("payPal").equals(skeleton("paypal")); // false

// The skeleton representation does not remove diacritics
skeleton("paypal").equals(skeleton("pΓ α»³pΔ…l")); // false

Note on the use of Skeleton, from TR39:

A skeleton is intended only for internal use for testing confusability of strings; the resulting text is not suitable for display to users, because it will appear to be a hodgepodge of different scripts. In particular, the result of mapping an identifier will not necessary be an identifier. Thus the confusability mappings can be used to test whether two identifiers are confusable (if their skeletons are the same), but should definitely not be used as a "normalization" of identifiers.

Maven

<dependency>
  <groupId>com.github.mpkorstanje</groupId>
  <artifactId>tr39-confusables-skeleton</artifactId>
  <version>8.0.10</version>
</dependency>

Versions

Version
8.0.10
0.5.0