Search results

Pluggable test-item selection strategies for --max-instances (beyond random sampling)

Status: Open.

#1589 In mlcommons/modelbench;

· golipraneetha opened on Jul 26, 2026

Monitor together dedicated endpoints

Status: Open.

#1586 In mlcommons/modelbench;

· bkorycki opened on Jul 23, 2026

Preference for dedicated endpoints in dynamic HF and Together factories

Status: Open.

#1579 In mlcommons/modelbench;

· bkorycki opened on Jul 20, 2026

Fix broken jailbreak benchmark

Status: Open.

#1578 In mlcommons/modelbench;

· bkorycki opened on Jul 20, 2026

Modelbench respects inputs and accepts UID

Status: Open.

#1577 In mlcommons/modelbench;

· dhosterman opened on Jul 20, 2026

Update together dedicated endpoints to v2.0

Status: Open.

#1576 In mlcommons/modelbench;

· bkorycki opened on Jul 17, 2026

Security running in Candela

milestoneA goal that other cards add up toA goal that other cards add up to

Status: Open.

#1574 In mlcommons/modelbench;

· wpietri opened on Jul 14, 2026

Security (jailbreak) 1.1 benchmark

milestoneA goal that other cards add up toA goal that other cards add up to

Status: Open.

#1572 In mlcommons/modelbench;

· bollacker opened on Jul 13, 2026

Proposal: RL-specific reward-hacking safety benchmark / methodology contribution

Status: Open.

#1571 In mlcommons/modelbench;

· Aarav500 opened on Jul 10, 2026

Investigate huggingface failures / consistency check failures

Status: Open.

#1569 In mlcommons/modelbench;

· superdosh opened on Jul 2, 2026

Fairer together calling from cheval

Status: Open.

#1568 In mlcommons/modelbench;

· superdosh opened on Jul 2, 2026

Benchmark stalling issues

Status: Open.

#1565 In mlcommons/modelbench;

· superdosh opened on Jun 30, 2026