Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

Performance monitoring and benchmarking suite

The rDNA 2 dGPU support patch kext. No commercial use.

FanCtrl is a software that allows you to automatically control the fan speed on your PC.

Graphics Processing Unit (GPU) Architecture Guide

AMD GPU temperature monitoring on macOS. No commercial use.

Stable Diffusion UI: Diffusers (CUDA/ONNX)

Tensor Fusion is a state-of-the-art GPU virtualization and pooling solution designed to optimize GPU cluster utilization to its fullest potential.

ML software (llama.cpp, ComfyUI, vLLM) builds for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60

llama.cpp-gfx906

MIVisionX toolkit is a comprehensive computer vision and machine intelligence libraries, utilities and applications bundled into a single toolkit.

Fix OpenCL detection and performance issues on AMD Radeon GPU's by registering Installable Client Driver (ICD) files.

Multi AMD GPU Setup for AI Development on Ubuntu with ROCM

GPU-accelerated LLaMA inference wrapper for legacy Vulkan-capable systems a Pythonic way to run AI with knowledge (Ilm) on fire (Vulkan).

🐱‍💻 GPU Info API is an API that provides detailed information about Nvidia, AMD, and Intel GPUs. The information is extracted from Wikipedia and stored in JSON format.

Client for the Jellyfin Hardware Survey Server (https://hwa.jellyfin.org/). Benchmarks hardware performance for simultaneous ffmpeg transcoding, enabling detailed comparisons and insights for optimizing Jellyfin setups.

A simplified mechanism for revealing GPU & system architecture information on any computer running any OS

Portably Performant Physical Algebra

Run Ollama on AMD Ryzen 7 5800H CPU with integrated GPU AMD ATI Radeon Vega (gfx90c) with optimizations

Minimal curses dashboard for monitoring AMD GPUs via amd-smi.