Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

Pull requests: ModelTC/LightLLM

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort

Pull requests list

feat(quant): add triton fp8 w8a8 per-tensor quantization method
#1404 opened Jul 24, 2026 by sufubao Collaborator Loading…
fix(security): 2 improvements across 1 files
#1401 opened Jul 23, 2026 by tomaioo Loading…
zero deepstack layers on slot when audio reuse
#1400 opened Jul 22, 2026 by WANDY666 Contributor Loading…
feat: interleave CPU KV cache pages across NUMA nodes
#1399 opened Jul 21, 2026 by sufubao Collaborator Loading…
fix: reduce memory occupation and raise performance for multi-nodes
#1396 opened Jul 17, 2026 by blueswhen Collaborator Loading…
fix: fix bugs in the ep v2 and mega moe for sm100
#1392 opened Jul 15, 2026 by blueswhen Collaborator Loading…
feat: gc.freeze hot processes and disable gc during cudagraph capture
#1382 opened Jul 5, 2026 by sufubao Collaborator Loading…
Cache aware for pd
#1379 opened Jul 2, 2026 by kingder Collaborator Loading…
static cost
#1374 opened Jun 30, 2026 by shihaobai Collaborator Loading…
Support GLM-5.2 (glm_moe_dsa, DeepSeek-V3.2-style DSA MoE)
#1370 opened Jun 25, 2026 by sufubao Collaborator Loading…
feat: fuse add and rmsnorm
#1368 opened Jun 24, 2026 by blueswhen Collaborator Loading…
fix stream fc for qwen3_coder
#1364 opened Jun 18, 2026 by shihaobai Collaborator Loading…
Support default chat template kwargs
#1363 opened Jun 18, 2026 by sufubao Collaborator Loading…
support ds4
#1355 opened Jun 15, 2026 by WANDY666 Contributor Loading…
feat: add gguf support
#1354 opened Jun 15, 2026 by zhangts20 Collaborator Loading…
feat: add multi-platform support with ascend and maca
#1335 opened Jun 8, 2026 by zhangts20 Collaborator Loading…
feat: update disk cache params and benchmark_multiturn.py
#1333 opened Jun 8, 2026 by blueswhen Collaborator Loading…
Fa4 support
#1327 opened Jun 2, 2026 by blueswhen Collaborator Loading…
add in-process URL pool caching
#1325 opened Jun 1, 2026 by Owleye4 Contributor Loading…
update cpu cache load use async way.
#1318 opened May 25, 2026 by hiworldwzj Collaborator Loading…
support mtp for gemma4
#1316 opened May 22, 2026 by WANDY666 Contributor Loading…
ProTip! Adding no:label will show everything without a label.
Morty Proxy This is a proxified and sanitized view of the page, visit original site.