🤖 The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P and decentralized inference

AI模型聚合管理中转分发系统，支持将多种大模型转为统一格式调用，支持OpenAI、Claude、Gemini等格式，可供个人或者企业内部管理与分发渠道使用。🍥 The next-generation LLM gateway and AI asset management system supports multiple languages.

llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2

gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。

rerank library for easy reranking of results

A BM25 Java implementation using streams, stop words and stemming.

A corporate law RAG system with innovative retrieval and contextual strategies

基于FastAPI的文本嵌入向量生成API， 处理Embedding+Rerank模型，兼容OpenAI、硅基流动格式

Rapid Deployment of LLM and Embedding Based on VLLM Using Docker

SearchAugmentedLLM empowers LLMs with information from the web

Automated fact-check

基于 LangGraph 实现的聊天机器人，接入 DeepSeek、Qwen、智谱 AI 多个 LLM 模型，支持在线搜索和文件解析。

A comprehensive RAG FastAPI service that handles document uploads and retrievals, built with Python. Uses PyMuPDF for document processing, turbopuffer for vector storage, OpenAI for models, and cohere for reranking.

A Python project that deploys a Local RAG chatbot using Ollama API and vLLM API. Refines answers with internal RAG knowledge base, using both Embedding and Rerank models to improve accuracy of context provided to LLM models.

This configuration is from the ChatGPT source code.

CRoM (Context Rot Mitigation)-EfficientLLM is a Python toolkit designed to optimize the context provided to Large Language Models (LLMs). It provides a suite of tools to intelligently select, re-rank, and manage text chunks to fit within a model's context budget while maximizing relevance and minimizing performance drift.

Develop an nlp-based method to predict the affinity between misconceptions and incorrect answers (distractors) in multiple-choice questions.

企业RAG技术实战项目（简历项目）

llama-factory实战项目（简历项目）

rerank技术实战项目（简历项目）