text2vec is an R package which provides an efficient framework with a concise API for text analysis and natural language processing (NLP). Fast vectorization, topic modeling, distances and GloVe word embeddings in R.
This package is efficient because it is carefully written in C++, which also means that text2vec is memory friendly. Some parts (such as GloVe) are fully parallelized using the RcppParallel package.
text2vec is inspired by gensim. The software is released under an open source license.
Features include:
- Fast text vectorization (creation of document-term matrices) on arbitrary n-grams, using vocabulary or feature hashing.
- GloVe word embeddings.
- Topic modelling with:
- Latent Dirichlet Allocation – decomposes document-term matrix into two low-rank matrices – document-topic distribution and topic-word distribution. It’s a more complex non-linear generative model.
- Latent Semantic Analysis – oldest among topic modeling techniques. It also decomposes Document-Term matrix into a product of 2 low rank matrices.
- Provides 2 set of functions for measuring various distances/similarity in a unified way. All methods are written with special attention to computational performance and memory efficiency. Functions for fast calculation of similarity between documents (specifically similarities and distances between matrices):
- Cosine distance – classical approach from computational linguistics is to measure similarity based on the content overlap between documents.
- Jaccard distance – a simple but intuitive measure of similarity between two sets.
- Relaxed Word Mover’s Distance.
- Euclidean – with text2vec it can only be computed on dense matrices.
- Streaming API means that users do not have to load all the data into RAM:
- Vectorization.
- I/O handling.
- Easy parallel processing – provides convenient functions for easy parallel processing of text.
- Models – provides unified interface for models, which is inspired by scikit-learn interface. Models in text2vec are mostly transformers and decompositions.
Website: text2vec.org
Support: GitHub Code Repository
Developer: Dmitry Selivanov and contributors
License: GNU General Public License v2.0
text2vec is written in R. Learn R with our recommended free books and free tutorials.
Return to Natural Language Processing | Return to R Natural Language Tools Page | Return to C++ Natural Language Tools
| Popular series | |
|---|---|
 | The largest compilation of the best free and open source software in the universe. Each article is supplied with a legendary ratings chart helping you to make informed decisions. |
 | Hundreds of in-depth reviews offering our unbiased and expert opinion on software. We offer helpful and impartial information. |
 | The Big List of Active Linux Distros is a large compilation of actively developed Linux distributions. |
 | Replace proprietary software with open source alternatives: Google, Microsoft, Apple, Adobe, IBM, Autodesk, Oracle, Atlassian, Corel, Cisco, Intuit, and SAS. |
 | Awesome Free Linux Games Tools showcases a series of tools that making gaming on Linux a more pleasurable experience. This is a new series. |
 | Machine Learning explores practical applications of machine learning and deep learning from a Linux perspective. We've written reviews of more than 40 self-hosted apps. All are free and open source. |
 | New to Linux? Read our Linux for Starters series. We start right at the basics and teach you everything you need to know to get started with Linux. |
 | Alternatives to popular CLI tools showcases essential tools that are modern replacements for core Linux utilities. |
 | Essential Linux system tools focuses on small, indispensable utilities, useful for system administrators as well as regular users. |
 | Linux utilities to maximise your productivity. Small, indispensable tools, useful for anyone running a Linux machine. |
 | Surveys popular streaming services from a Linux perspective: Amazon Music Unlimited, Myuzi, Spotify, Deezer, Tidal. |
 | Saving Money with Linux looks at how you can reduce your energy bills running Linux. |
 | Home computers became commonplace in the 1980s. Emulate home computers including the Commodore 64, Amiga, Atari ST, ZX81, Amstrad CPC, and ZX Spectrum. |
 | Now and Then examines how promising open source software fared over the years. It can be a bumpy ride. |
 | Linux at Home looks at a range of home activities where Linux can play its part, making the most of our time at home, keeping active and engaged. |
 | Linux Candy reveals the lighter side of Linux. Have some fun and escape from the daily drudgery. |
 | Getting Started with Docker helps you master Docker, a set of platform as a service products that delivers software in packages called containers. |
 | Best Free Android Apps. We showcase free Android apps that are definitely worth downloading. There's a strict eligibility criteria for inclusion in this series. |
 | These best free books accelerate your learning of every programming language. Learn a new language today! |
 | These free tutorials offer the perfect tonic to our free programming books series. |
 | Linux Around The World showcases usergroups that are relevant to Linux enthusiasts. Great ways to meet up with fellow enthusiasts. |
 | Stars and Stripes is an occasional series looking at the impact of Linux in the USA. |