A Compiler Writing Journey

百度NLP：分词，词性标注，命名实体识别，词重要性

xmnlp：提供中文分词, 词性标注, 命名体识别，情感分析，文本纠错，文本转拼音，文本摘要，偏旁部首，句子表征及文本相似度计算等功能

DFA regular expression library & friends

INTERSPEECH 2023-2024 Papers: A complete collection of influential and exciting research papers from the INTERSPEECH 2023-24 conference. Explore the latest advances in speech and language processing. Code included. Star the repository to support the advancement of speech technology!

Chinese text segmentation with R. R语言中文分词 （文档已更新 🎉 ：https://qinwenfeng.com/jiebaR/ )

A lexical analyzer based on DFA that is built using JS and supports multi-language extensions / 一个基于DFA的支持多语言扩展的JS版开源词法分析器

LLVM Tutorial: Kaleidoscope (Implementing a Language with LLVM)

Allocators, I/O streams, math, geometry, image and audio processing for D

This is an implementation of a compiler for a simple C-like language that uses the C tools Flex and Bison.

OysterKit is a framework that provides a native Swift scanning, lexical analysis, and parsing capabilities. In addition it provides a language that can be used to rapidly define the rules used by OysterKit called STLR

A compiler that accepts any valid program written in C. It is made using Lex and Yacc. Returns a symbol table, parse tree, annotated syntax tree and intermediate code.

[EMNLP 2021] LingFeat - A Comprehensive Linguistic Features Extraction ToolKit for Readability Assessment

😸 💬 A module to compute textual lexical richness (aka lexical diversity).

clex is a simple lexer generator

Santiago is a lexing and parsing toolkit for Rust

A procedural programming language built in Rust which compiles to QBE

Modular static malicious JavaScript detection system

A simple compiler written from scratch in C++ for an undergraduate course in program translation.

Perform lexical analysis on words, one word at a time.