Topic: text-processing

learnbyexample / Command-line-text-processing

7.9k

⚡️ From finding text to search and replace, from sorting to beautifying text and more 🎨

command-line linux text-processing ebook sed grep perl awk ruby

Shell Updated Mar 3, 2019

google / diff-match-patch

1.5k

Diff Match Patch is a high-performance library in multiple languages that manipulates plain text.

difference diff match patch text-processing

Python Updated Mar 12, 2019

chmln / sd

553

Intuitive find & replace CLI (sed alternative)

command-line rust terminal text-processing regex

Rust Updated Mar 3, 2019

proycon / pynlpl

362

PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules u…

nlp python computational-linguistics linguistics library folia machine-learning language-modelling search-algorithms evaluation-metrics text-processing nlp-library natural-language-processing

Python Updated Mar 13, 2019

open-korean-text / open-korean-text

334

Open Korean Text Processor - An Open-source Korean Text Processor

korean korean-text-processing natural-language-processing text-processing tokenizer korean-tokenizer

Scala Updated Aug 7, 2018

abadojack / whatlanggo

321

Natural language detection library for Go

language go nlp text-processing

Go Updated Mar 6, 2019

derek73 / python-nameparser

314

A simple Python module for parsing human names into their individual components

python text-processing text-parser python-module

Python Updated Jan 29, 2019

fastnlp / fastNLP

285

fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.

natural-language-processing deep-learning nlp-library nlp-parsing chinese-nlp text-classification text-processing

Python Updated Mar 22, 2019

airbnb / artificial-adversary

263

🗣️ Tool to generate adversarial text examples and test machine learning models against them

Python Updated Oct 14, 2018 1 issue needs help

pyparsing / pyparsing

230

python python2 python3 python-2 python-3 parser-combinators parsing-expression-grammar parsing parsing-library text-processing

Python Updated Mar 12, 2019

cbaziotis / ekphrasis

172

Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis…

nlp text-processing nlp-library spelling-correction tokenizer tokenization word-segmentation word-normalization spell-corrector text-segmentation semeval

Python Updated Nov 22, 2018

hakatashi / japanese.js

132

Util collection for Japanese text processing. Hiraganize, Katakanize, and Romanize.

japanese text-processing javascript utility romanize hiragana katakana

JavaScript Updated Mar 13, 2019

stanfordnlp / stanza

129

Stanford NLP group's shared Python tools.

python nlp text-analysis text-processing natural-language-processing

Python Updated Mar 14, 2018

open-i18n / rust-unic

125

UNIC: Unicode and Internationalization Crates for Rust

unicode internationalization text-processing crates rust cldr locale-data unic unicode-characters unicode-algorithms internationalization-crates

Rust Updated Mar 5, 2019 11 issues need help

CogComp / cogcomp-nlpy

102

CogComp's light-weight Python NLP annotators

natural-language-processing text-processing nlp text-mining data-mining

Python Updated Feb 18, 2019

BurntSushi / regex-automata

101

A low level regular expression library that uses deterministic finite automata.

regex dfa automata text-processing

Rust Updated Feb 25, 2019

zveryansky / textvec

90

Text vectorization tool to outperform TFIDF for classification tasks

python nlp machine-learning text-analysis text-classification text-processing tf-idf natural-language-processing

Python Updated Sep 10, 2018

proycon / colibri-core

85

Colibri core is an NLP tool as well as a C++ and Python library for working with basic linguistic constructions such …

c-plus-plus python nlp ngrams skipgram ngram corpus linguistics library text-processing computational-linguistics pattern-recognition

C++ Updated Jan 15, 2019

Kyubyong / mtp

85

Multi-lingual Text Processing

text-processing

Updated Jan 22, 2019

assafmo / xioc

81

Extract indicators of compromise from text, including "escaped" ones.

ioc iocs extract extraction text-mining text-processing indicators-of-compromise command-line-tool command-line defang escaping regex regexp data-mining

Go Updated Jan 30, 2019

linuxscout / pyarabic

79

pyarabic

nlp-library arabic-language text-processing

Python Updated Aug 20, 2018

gunapandianraj / iOS11-VisionFrameWork

78

Vision Framework IOS WWDC 2017

image-analysis face-detection rectangle-detection char-detection ios-vision visionframework wwdc2017 ios machine learning text-detection text-processing

Swift Updated Jun 26, 2017

kefirfromperm / kefirbb

75

A flexible Java text processor. BB, BBCode, BB-code, HTML, Textile, Markdown, parser, translator, converter.

bbcode java textile html markdown text-processing java-library converter translator html-filtration

Java Updated Oct 19, 2016

nschneid / unix-text-commands

74

Unix Text Processing Command Reference

unix text-processing nlp command-line reference

Updated Sep 12, 2016

MilesCranmer / vim-stream

71

vims - use vim commands for pipeline filtering in terminal

vim sed unix-command unix-pipes stdin regex ex awk vim-stream vims text-processing

Shell Updated Aug 12, 2018

waseem18 / node-rake

68

A NodeJS implementation of the Rapid Automatic Keyword Extraction algorithm.

nodejs text-processing keyword-extraction nlp-keywords-extraction

JavaScript Updated Jan 9, 2019 1 issue needs help

ikegami-yukino / jaconv

66

Pure-Python Japanese character interconverter for Hiragana, Katakana, Hankaku and Zenkaku

japanese-language preprocessing python text-processing japanese-kana

Python Updated Feb 3, 2019

MycroftAI / padatious

61

A neural network intent parser

intent-classification text-analysis language-processing intent text-processing language-detection