Search results

[Refactor] For PP, wrap model and schedule into a wrapper model so that Trainer does not need to know about PP

Status: Open.

Task

#416 In Modalities/modalities;

· BlueCrescent opened on Nov 5, 2025

Integration of (interleaved) 1f1b pipeline schedule

Status: Open.

#408 In Modalities/modalities;

· le1nux opened on Oct 8, 2025

Define initial grid search

Status: Open.

#406 In Modalities/modalities;

· le1nux opened on Oct 8, 2025

Check Warmstart with PP

Status: Open.

#405 In Modalities/modalities;

· le1nux opened on Oct 8, 2025

Epic: HF Checkpoint Conversion

Status: Open.

#403 In Modalities/modalities;

· le1nux opened on Oct 8, 2025

Epic: Weight tying issues with FSDP2 and DCP

Status: Open.

#400 In Modalities/modalities;

· le1nux opened on Oct 8, 2025

Modalities expects JSONL to have a trailing \n for the last JSON document (best practice but not guaranteed by JSONL file format)

bugSomething isn't workingSomething isn't working

Status: Open.

#395 In Modalities/modalities;

· le1nux opened on Aug 19, 2025

Hashing of config file content instead of config file path as part of the experiment_id

Status: Open.

#388 In Modalities/modalities;

· le1nux opened on Jul 22, 2025

SentencePiece Tokenizer does not encode </s> as special token

bugSomething isn't workingSomething isn't working

Status: Open.

Bug

#383 In Modalities/modalities;

· le1nux opened on Jul 6, 2025

Reduce / clean up console logging

enhancementNew feature or requestNew feature or request

Status: Open.

Task

#376 In Modalities/modalities;

· le1nux opened on Jun 16, 2025

Check if all InstantiationModels require all of the specified top-level components

Status: Open.

#373 In Modalities/modalities;

· le1nux opened on Jun 2, 2025

Tutorial on scaling up model training (Troughput Profiler)

Status: Open.

#372 In Modalities/modalities;

· le1nux opened on May 26, 2025