STREAM, for lots of devices written in many programming models

Provides a set of benchmarks that can be used to measure the memory bandwidth performance of CPU's

A Fast DNN Accelerator Design Space Exploration Framework.

Modern Memory Bandwidth and Latency Benchmarks

Demo code accompanying the talk "Implementing memory locality optimizations in OpenFOAM based code"

A macOS memory benchmark tool that measures read/write performance in GB/s.

Main Memory Bandwidth Monitoring

General-purpose compile-time Expression Templates library for C++

Measure and visualize why LLM inference is slow: bottleneck analysis, model dissection, KV-cache, GEMM/GEMV, quantization, and memory-bound decoding.

C++23 benchmarking framework with 6 profiler backends, CUDA GPU support, statistical regression detection, cross-compilation for 5 architectures, and CLI tools for analysis and visualization.

Intent-aware KV execution prototype for agentic long-context inference: semantic block selection, dynamic scoring, KV quantization modeling, speculative prefetch simulation, CPU references, and future Triton/CUDA kernels.

Console UI for watching Memory stats

Reproducible Pascal GPU Unified Memory benchmark with Nsight and nvprof profiling

Standalone C++17 SYCL benchmarks for arithmetic, joint-matrix, device-memory, and USM transfer throughput without external compute libraries.

Python lab for exploring memory bandwidth, cache effects, and locality in accelerator workloads

OpenCL benchmarking tool to measure host-device bandwidth and kernel global memory throughput across GPUs and CPUs.

Measures actual GPU costs for LLM prefill and decode on RTX 2070 (8GB) to validate simulation parameters. Key findings: prefill converges to 30-70 us/token at long sequences; decode is memory-bandwidth-bound (constant with prefix length, 5300-10800 us/token single-request); simulation defaults are correct for server-level amortized batching.

Bandwidth-focused LLaMA token-generation latency benchmarking on Apple Silicon M4 vs M2 with TTFT, PTL, KV-cache, quantization projections, and reproducible architecture analysis.

Benchmark for memory bandwidth