The Natural Language Processing for JVM languages (NLP4J) project provides:
- NLP tools readily available for research in various disciplines.
- Frameworks for fast development of efficient and robust NLP components.
- API for manipulating computational structures in NLP (e.g., dependency graph).
Key Features
- Tokenization – takes a raw text and splits tokens by their morphological aspects. It also groups tokens into sentences. The tokenizer is based on the LDC tokenizer used for creating English Treebanks although it uses more robust heuristics:
- Emoticons are recognized as one unit (e.g.,
:-),^_^). - Hyperlinks are recognized as one unit (
emory.edu,[email protected],index.html). - Numbers consisting of punctuation are recognized as one unit (e.g.,
0.1,2/3). - Repeated punctuation are grouped together (e.g.,
---,...). - Abbreviations are recognized as one unit (e.g.,
Prof.,Ph.D). - File extensions are not tokenized (e.g.,
clearnlp.zip,tokenizer.doc). - Units are tokenized (e.g.,
1 kg,2 cm). - Usernames including periods are recognized as one unit (e.g.,
jinho.choi).
- Emoticons are recognized as one unit (e.g.,
- Morphological analyzer – enerates root forms (lemmas) of word tokens. It is a rule-based analyzer inspired by the WordNet morphy although it uses a larger dictionary gathered from various sources and more advanced heuristics. It also normalizes numbers, redundant punctuation, hyperlinks, etc.
- Part-of-Speech Tagging – uses the generalized model from dynamic model selection and utilizes ambiguity classes trained on a large corpus.
- Named Entity Recognition – uses both sparse and dense features extracted from named entity gazetteers, word clusters, and word embeddings.
- Dependency Parsing – uses a transition-based, non-projective parsing algorithm showing a linear-time speed for both projective and non-projective parsing.
Website: emorynlp.github.io/nlp4j
Support: Forum, GitHub Code Repository
Developer: Emory NLP research group
License: Apache License, Version 2.0
NLP4J is written in Java. Learn Java with our recommended free books and free tutorials.
Related Software
| Java Natural Language Processing Tools | |
|---|---|
| CoreNLP | Annotation-based NLP pipeline that provides core natural language analysis |
| OpenNLP | Machine learning based toolkit |
| DL4J | Deploy and train deep learning models |
| Lucene | High-performance, full-featured information retrieval software library |
| UIMA | Open source implementation of the UIMA specification |
| Tika | Content analysis toolkit |
| MALLET | Statistical natural language processing, document classification and more |
| GATE | Full-lifecycle solution for a broad range of NLP tasks |
| ReVerb | Automatically identifies and extracts binary relationships from sentences |
| NLP4J | NLP framework for JVM languages |
| CogComp-NLP | State-of-the-art Natural Language Processing (NLP) tools |
Read our verdict in the software roundup.
 Explore our carefully curated directory of recommended free and open source software, covering every major software category.The directory forms part of our extensive collection of articles for Linux enthusiasts. It includes hundreds of detailed reviews, together with free and open source alternatives to proprietary software from companies such as Google, Microsoft, Apple, Adobe, IBM, Cisco, Oracle, and Autodesk. LinuxLinks also covers interesting projects worth exploring, Linux-compatible hardware, free programming books and tutorials, and much more. Know a useful free and open source Linux application that we haven’t covered? Tell us about it using our submission form. |
Please read our Comment Policy before commenting.