JarCastingexude demo
This is simple library for removing/filtering the stopping,stemming words from the text data, this library is in very basic level of development need to work on for later changes.
This is the part of maven repository now,Directly add in pom following.
<dependency>
<groupId>com.uttesh</groupId>
<artifactId>exude</artifactId>
<version>0.0.4</version>
</dependency>
How to use exude Library
Download latest version of exude download
Features:
- Filter stopping words from given text/file/link
- Filter stemming words from given text/file/link
- Get swear words from given text/file/link
How Exude library works:
Step 1: Filter the duplicate words from the input data/file.
Step 2: Filter the stopping words from step1 filtered data.
Step 3: Filter the stemmer/swear words from step2 filtered data using the Porter algorithm which is used for suffix stripping.
exude process sequence flow:
Environment and dependent jar file
- Minimum JDK 1.6 or higher
- Apache Tika jar (which is used to parse the files for the data extraction)
Sample code:
Sample Text Data
String inputData = "Kannada is a Southern Dravidian language, and according to Dravidian scholar Sanford Steever, its history can be conventionally divided into three periods; Old Kannada (halegannada) from 450–1200 A.D., Middle Kannada (Nadugannada) from 1200–1700 A.D., and Modern Kannada from 1700 to the present.[20] Kannada is influenced to an appreciable extent by Sanskrit. Influences of other languages such as Prakrit and Pali can also be found in Kannada language.";
String output = ExudeData.getInstance().filterStoppings(inputData);
System.out.println("output : "+output);
Sample File Data
String inputData = "any file path";
String output = ExudeData.getInstance().filterStoppings(inputData);
System.out.println("output : "+output);
Sample Link Data
String inputData = "https://en.wikipedia.org/wiki/Rama";
String output = ExudeData.getInstance().filterStoppings(inputData);
System.out.println("output : "+output);
Get swear words from data/file/link
String inputData = "enter text with bad words";
String output = ExudeData.getInstance().getSwearWords(inputData);
System.out.println("output : "+output);
New Feature:
- Keep the duplicate words after the filterStoppings
Sample Text Data
String inputData = "testing testing testing the keep keep the the duplicate data data in result";
String output = ExudeData.getInstance().filterStoppingsKeepDuplicates(inputData);
System.out.println("output : "+output);
contributions
Credit apache tika which is used to parse the files for the data extraction.
Exude library Developer : uttesh.com
License
(The Apache License)
Copyright (c) 2018 Uttesh Kumar T.H.
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.