Search results

能否增加对qwen3的支持？或者如何在其他框架中使用（ada）lomo优化器？

Status: Open.

#191 In OpenMOSS/CoLLiE;

· LRC-bit opened on Jun 24, 2025

如果想应用更多的模型，例如InstructBLIP，请问应该怎么修改呢？

Status: Open.

#181 In OpenMOSS/CoLLiE;

· Listever opened on May 20, 2024

lomo训练65b llama实测 Lomo is incompatible with pipeline parallelism

Status: Open.

#152 In OpenMOSS/CoLLiE;

· zlh1992 opened on Feb 4, 2024

能否增加一个从头预训练的例子？

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#151 In OpenMOSS/CoLLiE;

· liujuncn opened on Jan 26, 2024

支持 RLHF

Status: Open.

#145 In OpenMOSS/CoLLiE;

· KYLN24 opened on Dec 19, 2023

你好，怎么让保存的模型能够分片，而不是保存一个几十G的大模型

enhancementNew feature or requestNew feature or request

Status: Open.

#143 In OpenMOSS/CoLLiE;

· 459737087 opened on Dec 14, 2023

关于 adalomo 没有 loss_scaler 只有 loss_scale 的问题

Status: Open.

#139 In OpenMOSS/CoLLiE;

· HappyLynn opened on Nov 29, 2023

chatGLM2 好像目前不支持ptuning训练，有计划什么时候支持么

bugSomething isn't workingSomething isn't working

Status: Open.

#136 In OpenMOSS/CoLLiE;

· BlueSkyyyyyy opened on Nov 15, 2023

AdaLomo optimizer step method

Status: Open.

#132 In OpenMOSS/CoLLiE;

· winglian opened on Oct 30, 2023

使用数据类_ShardContainer遇到错误

Status: Open.

#123 In OpenMOSS/CoLLiE;

· xuguohai opened on Sep 21, 2023

How to convert parallel state_dict to normal state_dict?

Status: Open.

#122 In OpenMOSS/CoLLiE;

· JinchaoLove opened on Sep 18, 2023

[BUG] Evaluation 时使用并行可能不会完整地遍历一遍数据

Status: Open.

#119 In OpenMOSS/CoLLiE;

· KYLN24 opened on Sep 14, 2023