The official evaluation suite and dynamic data release for MixEval.

GERBIL - General Entity annotatoR Benchmark

Benchmark framework of compute-in-memory based accelerators for deep neural network (on-chip training chip focused)

MLOS is a project to enable autotuning for systems.

Python Multi-Process Execution Pool: concurrent asynchronous execution pool with custom resource constraints (memory, timeouts, affinity, CPU cores and caching), load balancing and profiling capabilities of the external apps on NUMA architecture

SustainDC is a set of Python environments for Data Center simulation and control using Heterogeneous Multi Agent Reinforcement Learning. Includes customizable environments for workload scheduling, cooling optimization, and battery management, with integration into Gymnasium.

A toolkit for auto-generation of OpenAI Gym environments from RDDL description files.

NPBench - A Benchmarking Suite for High-Performance NumPy

Benchmark framework of compute-in-memory based accelerators for deep neural network (on-chip training chip focused)

PIMeval simulator and PIMbench suite

A guidance for the design and evaluation of motion planners for quadrotors in Environments with Varying Complexities

Arline Benchmarks platform allows to benchmark various algorithms for quantum circuit mapping/compression against each other on a list of predefined hardware types and target circuit classes

Benchmarking machine learning inferencing on embedded hardware.

Command execution time meter

The greatest collection of the worst code

Benchmark framework of compute-in-memory based accelerators for deep neural network (inference engine focused)

Telco pIPeline benchmarking SYstem

Benchmarking framework for Feature Selection and Feature Ranking algorithms 🚀

Benchmarking optimization solvers.

Write Benchmarks like Tests