Categories

Natural Language Processing

Libraries for working with human languages.

Repos

81

Stars

34,041

30 days

+70

Language Detection

pemistahl

The most accurate natural language detection library for Go, suitable for short text and mixed-language text

Created Nov 2020

go golang-library language-classification language-detection language-identification
Total 1,370
30 days +4
abadojack

Natural language detection library for Go

Created Feb 2017

go language nlp text-processing
Total 698
30 days +2
rylans

Natural language detection package in pure Go

Created Mar 2018

language-model natural-language nlp
Total 176
30 days +0
endeveit

Guess the natural language of a text in Go

Created Dec 2014

Total 58
30 days +0

Morphological Analyzers

nlpodyssey

Self-contained Machine Learning and Natural Language Processing library in Go

Created Jan 2020

artificial-intelligence automatic-differentiation automatic-translation bart bert
Total 1,853
30 days +2
ikawaha

Self-contained Japanese Morphological Analyzer written in pure Go

Created Jun 2014

hacktoberfest japanese japanese-language korean morphological-analysis
Total 989
30 days +4
james-bowman

Selected Machine Learning algorithms for natural language processing and semantic analysis in Golang

Created Mar 2017

feature-hash go golang latent-dirichlet-allocation latent-semantic-analysis
Total 478
30 days +1
afjoseph

A Go port of the Rapid Automatic Keyword Extraction algorithm (RAKE)

Created Dec 2016

Total 123
30 days +0
agonopol

Word Stemming in Go

Created Sep 2011

Total 81
30 days +0
jonreiter

vader sentiment analysis in go

Created Jan 2020

Total 56
30 days +0
danieldk

Read and use word2vec vectors in Go

Created Jan 2015 Archived

embeddings go golang word2vec
Total 57
30 days +0

Slugifiers

gosimple

URL-friendly slugify with multiple languages support.

Created Mar 2014

go slug
Total 1,336
30 days +2

Tokenizers

go-ego

Go efficient fast multilingual NLP and text segmentation; support English, Chinese, Japanese and others.

Created Jun 2017

chinese english go gse hmm
Total 2,848
30 days +9
yanyiwu

"结巴"中文分词的Golang版本

Created Sep 2015

Total 2,652
30 days +5
neurosnap

A multilingual command line sentence tokenizer in Golang

Created Aug 2015

cli sentence-tokenizer sentences tokenizer
Total 472
30 days +1
blevesearch

A Go library for performing Unicode Text Segmentation as described in Unicode Standard Annex #29

Created Oct 2014

Total 90
30 days +0
pebbe

A Go package for n-gram based text categorization, with support for utf-8 and raw text

Created Sep 2012

Total 73
30 days +0
awsong

Chinese word splitting algorithm MMSEG in GO

Created Apr 2012

Total 62
30 days +0
dchest

Stemmer packages for Go programming language. Includes English, German and Dutch stemmers.

Created Mar 2011

Total 56
30 days +0

Translation

nicksnyder

Translate your Go program into multiple languages.

Created Jan 2012

cldr go i18n translation translation-files
Total 3,556
30 days +11
mozillazg

汉字转拼音

Created Nov 2014

chinese go golang hanzi hanzi-pinyin
Total 1,796
30 days +2
leonelquinteros

Go (Golang) GNU gettext utilities package

Created Jun 2016

gettext go golang i18n internationalization
Total 515
30 days +2
invopop

Go Context Internationalization - translating apps easily

Created Mar 2024

Total 96
30 days +0
vorlif

Flexible translation and humanization library for Go, based on the concepts behind gettext.

Created May 2022

gettext go golang i18n internationalization
Total 95
30 days +1
mehanizm

Transliterate Cyrillic → Latin in every possible way

Created Apr 2020

cyrillic go golang russian translit
Total 56
30 days +0

Transliteration

mozillazg

ASCII transliterations of Unicode text.

Created Jul 2016

go golang unidecode
Total 146
30 days +0
fiam

Unicode transliterator for #golang

Created May 2012

Total 80
30 days +0

More

jdkato

📖 A Golang library for text processing, including tokenization, part-of-speech tagging, and named-entity extraction.

Created Feb 2017

natural-language-processing nlp prose
Total 3,097
30 days +5
huichen

Go中文分词

Created Jul 2013

Total 1,816
30 days +0
alasdairforsythe

Ungreedy subword tokenizer and vocabulary trainer for Python, Go, C++ & Javascript

Created May 2023

text-tokenization tokenisation tokenization tokenize tokenizer
Total 626
30 days +2
jinzhu

Pluralizes and singularizes English nouns

Created Jul 2015

go golang inflection
Total 529
30 days +2
wangbin

Jieba 分词 Go 语言版

Created Oct 2013

Total 506
30 days +0
tiktoken-go

Pure Go implementation of OpenAI's tiktoken tokenizer

Created Apr 2023

Total 463
30 days +5
go-playground

💬 i18n Translator for Go/Golang using CLDR data + pluralization rules

Created Feb 2016

cldr golang i18n l10n language
Total 429
30 days +3
lqez

An awesome list of Hangul/Korean related libraries and modules

Created Feb 2019

Total 376
30 days +0
sugarme

NLP tokenizers written in Go language

Created Aug 2020

deep-learning golang-tokenizer nlp tokenizer
Total 342
30 days +1
go-playground

🌎 a set of locales generated from the CLDR Project which can be used independently or within an i18n package; these were built for use with, but not exclusive to https://github.com/go-playground/universal-translator

Created Aug 2016

cldr l10n plural-rules
Total 309
30 days +2
kljensen

Go implementation of the Snowball stemmers

Created Apr 2013

Total 296
30 days +0
cdipaolo

Simple Sentiment Analysis in Golang

Created Jul 2015

Total 281
30 days +0
hangulize

Hangulize transcribes non-Korean words into Hangul

Created May 2018

korean linguistics transcription
Total 251
30 days +0
liuzl

Golang version OpenCC 繁簡轉換

Created Feb 2018

chinese-translation simplified-chinese traditional-chinese
Total 249
30 days +1
go-ego

Golang Chinese to Pinyin

Created Jun 2017

chinese go golang pinyin
Total 197
30 days +0
reiver

A native Go clean room implementation of the Porter Stemming algorithm.

Created Jun 2013

Total 194
30 days +0
varnamproject

Easily type Indic languages on computer and mobile. GoVarnam is a cross-platform transliteration library. Manglish -> Malayalam, Thanglish -> Tamil, Hinglish -> Hindi plus another 10 languages. GoVarnam is a near-Go port of libvarnam

Created Aug 2021

hindi ime input-method keyboard language
Total 177
30 days +0
gertd

Pluralize and singularize any word (golang adaptation of https://www.npmjs.com/package/pluralize)

Created Apr 2019

english golang language pluralization pluralize
Total 170
30 days +0
chewxy

package lingo provides the data structures and algorithms required for natural language processing

Created Apr 2017

conll-u go golang inflection language-model
Total 157
30 days +0
chrisport

A small library in golang, that detects the language of a text. (text categorization)

Created Nov 2014

human-language language-categorization language-detection language-profile offline-language-detection
Total 155
30 days +0
didasy

Text summarizer for golang using LexRank

Created Jan 2015

go golang lexrank nlp pagerank
Total 139
30 days +0
clipperhouse

A tokenizer based on Unicode text segmentation (UAX #29), for Go. Split graphemes, words, sentences.

Created Apr 2020

go golang nlp tokenization tokenizer
Total 125
30 days +1
machiel

Extremely small library that creates slugs for strings

Created Jun 2015

Total 125
30 days +0
gojp

Golang library for conversion between Japanese hiragana, katakana and romaji

Created Sep 2013

go golang-library hiragana japanese kana
Total 123
30 days +0
clipperhouse

Tokenizers and lemmatizers for Go

Created May 2018

data-science go lemmatizer nlp tokenizer
Total 120
30 days +0
Lofanmi

🇨🇳 采用 CC-CEDICT 词典的中文转拼音类库 提供更为准确的中文转拼音解决方案

Created Jul 2018

cc-cedict cedict go golang lastname
Total 102
30 days +0
eduardolat

🌍🚀 Effortlessly simple i18n for Go. Plurals, gender, and more made easy!

Created Aug 2023

Total 98
30 days +0
aaaton

A lemmatizer implemented in Go

Created Oct 2017

golang lemmatizer nlp
Total 98
30 days +1
chai2010

🆎 GNU gettext for Go (Imported By Kubernetes)

Created Mar 2014

gettext go golang i18n k8s
Total 93
30 days +0
gojp

Japanese Dictionary

Created Sep 2013

dictionary go golang japanese nihongo
Total 83
30 days +0
samber

Go BPE tokenizer (Encoder+Decoder) for GPT2 and GPT3

Created Dec 2022

bpe byte-pair-encoding codex decoder encoder
Total 82
30 days +0
gedex

Go library that pluralizes and singularizes English nouns.

Created Aug 2013

go inflector pluralization singularizes-english-nouns
Total 81
30 days +0
liuzl

Functional Meaning Representation and Semantic Parsing Framework

Created Nov 2017

backus-naur-form context-free-grammar earley fmr framenet
Total 79
30 days +0
korobool

Basic libraries and utils for Natural Language Processing with GoLang

Created Feb 2015

Total 76
30 days +0
knadh

KNphone is a phonetic algorithm for indexing Kannada words by their pronunciation, like Metaphone for English.

Created Jun 2019

Total 66
30 days +0
vube

golang package for basic i18n features, including message translation and number formatting

Created Jan 2014

Total 66
30 days +0
neurlang

IPA Phonemizer/Dephonemizer for 140 human languages

Created Jun 2024

g2p ipa p2g phonemizer phonetic-algorithm
Total 65
30 days +0
liuzl

Natural Language Processing Toolkit in Golang

Created Feb 2018

corenlp lemmatization nlp normalization opencc
Total 65
30 days +0
astaxie

collect locale data for use in golang

Created Oct 2012

Total 65
30 days +0
m1

i18n (Internationalization and localization) engine written in Go, used for translating locale strings.

Created Dec 2019

go go-generate go-i18n go-library golang
Total 63
30 days +0
axgle

convert chinese to pinyin

Created May 2012

Total 60
30 days +0
extemporalgenome

Go package for producing slugs, with slight sensitivity toward non-latin languages

Created Oct 2012

normalization
Total 55
30 days +1
chuanyi

golang 版中文分词包, inspired from 盘古分词

Created May 2013

Total 53
30 days +0
Nigh

romanizer for cjk character

Created May 2024

cjk golang romanizer
Total 52
30 days +0
go-i18n

Package i18n provides internationalization and localization for your Go applications

Created Sep 2021

cldr go i18n internationalization l10n
Total 52
30 days +0
eliben

Go implementation of the SentencePiece tokenizer

Created Aug 2024

encoding go golang language-model llm
Total 51
30 days +0
gojp

Golang package for Japanese grammar.

Created Oct 2013

go golang grammar japanese nihongo
Total 51
30 days +0
rainycape

Unicode transliterator in Golang - Replaces non-ASCII characters with their ASCII approximations.

Created Jun 2014

Total 49
30 days +0
nuance

Utilities for working with discrete probability distributions and other tools useful for doing NLP work

Created May 2011 Archived

Total 95
30 days +0
oscar-project

An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.

Created Mar 2019 Archived

common-crawl corpus-linguistics fasttext language-classification nlp
Total 86
30 days +0
unknwon

Package i18n is for app Internationalization and Localization.

Created Jun 2014 Archived

go i18n internationalization l10n localization
Total 84
30 days +0

From awesome-go (MIT), plus repos sorted by Jev.