Closed
Description
Describe the Issue
The current concedo branch is affected by the MoE crash in upstream's ggml-org#13437. It's fixed by upstream ggml-org#13435 in 4bc8f75
Additional Information:
I've manually cherry-picked the upstream commit into my local branch of 1.91 and it now allows my MoE models to be loaded. Given that it's a crash for common-ish model types it might be a good idea to hotfix.
Metadata
Metadata
Assignees
Labels
No labels