LSPRAG: Correct, Fast, for Multi-Language Testing

VS Code Extension for AI-Powered Unit Test Generation

This project is active. If you encounter any errors or have suggestions, feel free to open an issue!

LSPRAG (Language Server Protocol-based AI Generation) is a cutting-edge VS Code extension that leverages Language Server Protocol (LSP) integration and Large Language Models (LLMs) to automatically generate high-quality unit tests in real-time. By combining semantic code analysis with AI-powered generation, LSPRAG delivers contextually accurate and comprehensive test suites across multiple programming languages.

• Generate unit tests instantly as you code
• Context-aware test creation based on function semantics
• Intelligent test case generation with edge case coverage

• Java: Full support with JUnit framework
• Python: Comprehensive pytest integration
• Go: Native Go testing framework support
• Extensible: Easy to add support for additional languages

1. Download the extension named LSPRAG

2. Setup LLM in vscode settings

   Option A: VS Code Settings UI

   • Open Settings (Ctrl/Cmd + ,)
   • Search for "LSPRAG"
   • Configure provider, model, and API keys
   • for example, you can set provider as deepseek, and model as deepseek-chat, and you can also set provider as openai and model as gpt-4o-mini, or gpt-5.

   Option B: Direct JSON Configuration

   • For example, add below settings to .vscode/settings.json:

   {
     "LSPRAG": {
       "provider": "deepseek",
       "model": "deepseek-chat",
       "deepseekApiKey": "your-api-key",
       "openaiApiKey": "your-openai-key",
       "localLLMUrl": "http://localhost:11434",
       "savePath": "lsprag-tests",
       "promptType": "detailed",
       "generationType": "original",
       "maxRound": 3
     }
   }

3. You are ready!

1. Open Your Project

   • Open your workspace in the new VS Code editor
   • Or you can directly clone our project and move to its demo files
   • git clone https://github.com/THU-WingTecher/LSPRAG.git
   • Navigate to the demo test files: LSPRAG/src/test/fixtures/python
   • At Editor, click left-up File -> Open Folder -> Select workspace to LSPRAG/src/test/fixtures/python
   • [Optional] Test core utilities
     • You can check out your current setting by calling Cmd/Cntrl + Shift + P => LSPRAG: Show Current Settings
     • You can test your LLM avaialbility by calling Cmd/Cntrl + Shift + P => LSPRAG: Test LLM
     • You can test your Language Server avaialbility by calling Cmd/Cntrl + Shift + P => LSPRAG: Test Language Server

2. Generate Tests

   • Navigate to any function or method
   • Right-click within the function definition
   • Select "LSPRAG: Generate Unit Test" from the context menu
   • Wait for generation to complete

3. Review & Deploy

   • Generated tests will appear with accept/reject options
   

4. Final Result

   • All logs including LLM prompt and specific cfg, and diagnositc-fix histories will be saved under {your-workspace}/lsprag-workspace/
   • If you click [Accept] the test file, the test file will be saved at {your-workspace}/lsprag-tests
   • You can change the save path by chaning default value of save path. You can change it through VS Code Extension settings at the same interface with set up LLM.

• LSPRAG: Generate Unit Test - Generate tests for selected function
• LSPRAG: Show Current Settings - Display current configuration
• LSPRAG: Test LLM - Test LLM connectivity and configuration
• LSPRAG: Test Language Server - Test language server functionality (symbol finding & token extraction)

New to LSPRAG? Want to contribute? We've got you covered!

• Quick Start Guide - Get up and running in 5 minutes. Perfect for first-time contributors!
• Contributing Guide - Comprehensive guide explaining the codebase, architecture, and how to contribute

Recommended path for new contributors:

1. Start with Quick Start Guide to run your first test
2. Explore test files in src/test/suite/ (ast, lsp, llm)
3. Modify and experiment with existing tests
4. Read Contributing Guide for deep dive into architecture

{
  "LSPRAG.provider": "deepseek",
  "LSPRAG.model": "deepseek-chat",
  "LSPRAG.deepseekApiKey": "your-api-key"
}

{
  "LSPRAG.provider": "openai",
  "LSPRAG.model": "gpt-4o-mini",
  "LSPRAG.openaiApiKey": "your-api-key"
}

{
  "LSPRAG.provider": "ollama",
  "LSPRAG.model": "llama3-70b",
  "LSPRAG.localLLMUrl": "http://localhost:11434"
}

Ready to generate unit tests with LSPRAG! 🎉