Open Source Natural Language Processing Projects
Natural language processing (NLP) enables computers to analyze, understand, and generate human language. It addresses tasks such as classifying text, extracting information, translating, searching documents, and building conversational systems. NLP techniques range from rule-based text processing to machine learning models that learn patterns from large collections of language data. They help make unstructured text easier to organize and use, while supporting applications across languages and domains.
Open source NLP tools include libraries for tokenization and text analysis, pretrained models, data-processing utilities, evaluation frameworks, and applications for search or text generation. When choosing a tool, consider its license, documentation, maintenance, language coverage, computing requirements, and compatibility with your existing workflows. These resources can help researchers, developers, students, and organizations build language applications, study NLP methods, or adapt tools to specialized needs.
10 repositories · updated October 10, 2026
fuzzywuzzy: Match Similar Strings in Python
FuzzyWuzzy helps Python applications compare strings that differ in spelling, formatting, or word order. The repository is archived and points users to its renamed successor, TheFuzz.
ArchivedHealth 34/100
mergoo: Combine Fine-Tuned LLM Experts into Routed Models
Mergoo combines fine-tuned language models or LoRA adapters into routed expert models, then supports training the resulting model. It is aimed at teams that want one model to draw on specialized experts rather than use them separately.
InactiveHealth 25/100
ChatArena: Build Multi-Agent Language Game Environments
ChatArena is a Python framework for running language games with multiple LLM agents. It suits researchers and developers studying agent interaction, collaboration, and social behavior, but the project was deprecated in August 2025 and is no longer supported.
InactiveHealth 29/100
spacy-llm: Add LLM Tasks to spaCy NLP Pipelines
spacy-llm connects large language models to spaCy pipelines, turning model responses into structured NLP outputs without training data. It suits teams prototyping NLP tasks or combining LLM components with conventional spaCy processing.
ActiveHealth 49/100
Qwen: Run and Fine-Tune Pretrained Language Models
Qwen is Alibaba Cloud’s Python repository for running and adapting pretrained and chat language models, with an emphasis on Chinese and English. It includes inference, quantization, fine-tuning, and deployment paths, but is no longer actively maintained; the project points users to Qwen2.
QuietHealth 43/100
jieba: Segment Chinese Text in Python
jieba is a Python library for segmenting Chinese text into words, including text that does not use spaces as word boundaries. It offers configurable segmentation modes, custom dictionaries, part-of-speech tagging, and keyword extraction.
InactiveHealth 29/100
AudioSep: Separate Sounds from Natural-Language Descriptions
AudioSep is a Python foundation model for separating sounds from audio based on natural-language descriptions. It supports open-domain tasks such as isolating events, instruments, or speech, with inference, fine-tuning, and evaluation workflows.
InactiveHealth 28/100
translation-agent: Improve Translations with an LLM Reflection Workflow
translation-agent is a Python demonstration that uses an LLM to translate text, review its own draft, and revise it. It suits experimentation with style, regional language, and terminology, but is not presented as mature production software.
InactiveHealth 29/100
EasyEdit: Edit Knowledge and Steer Large Language Models
EasyEdit is a framework for changing specific knowledge or behavior in large language models and evaluating the effects. It brings together multiple editing and inference-time steering methods for researchers and developers comparing approaches or testing targeted edits.
ActiveHealth 62/100
sumy: Summarize Text and HTML Documents
sumy is a Python library and command-line tool that extracts concise summaries from plain text and HTML. It offers several extractive summarization methods, language tokenization support, and tools for evaluating summaries.
ActiveHealth 53/100