Enhance checkpoint management and multi-dataset training support#7445
Open
iam-knoit wants to merge 87 commits into
Open
Enhance checkpoint management and multi-dataset training support#7445iam-knoit wants to merge 87 commits into
iam-knoit wants to merge 87 commits into
Conversation
…tion-to-settings Add configurable checkpoint storage location
…tion-to-settings-4vf70s Add configurable checkpoint location (backend + UI) and make resume robust to changed roots
…lab-and-kaggle Auto-detect Hugging Face tokens in hosted notebooks
…lab-and-kaggle-mqqikw Resolve notebook HF_TOKEN (Colab/Kaggle) and expose it to frontend
…lab-and-kaggle-dz99yo Resolve notebook HF_TOKEN for hosted notebooks and hydrate frontend HF token store
…nctionality Add checkpoint retention and automatic Hub upload controls
…d-progress-handling Add credential-free checkpoint upload lifecycle with progress events and UI
…d-progress-handling-hdq7oj Add checkpoint upload lifecycle tracking and UI for Hugging Face checkpoint uploads
…et-selection-model Add structured multi-dataset training configuration
…nd-progress-handling-mwjzs9 Report and surface checkpoint upload lifecycle (Hub-safe uploads)
…set-selection-model-hs048g Support multiple structured training datasets (backend + frontend)
…nd-progress-handling-q2mo1i Add checkpoint upload lifecycle (backend events + frontend UI)
…-manifest-workflow Add crash-safe external checkpoint continuation storage
…io-resume-training-works Add portable_resume_data option to TrainingStartRequest
…io-resume-training-works-f7v5kx UI: add portable resume data options and redesign checkpoint resume picker; add API field
…ining-works-smy9sn
…io-resume-training-works-smy9sn Add portable resume data option and simplify checkpoint resume UI
…ining-works-t8jmyx
…io-resume-training-works-t8jmyx Add checkpoint resume flow, portable-resume-data UI, and backend inspect API mapping
…ining-works-1oqqce
…io-resume-training-works-1oqqce Add checkpoint resume workflow and disable editable config when resuming
…ining-works-75mum4
…io-resume-training-works-75mum4 Require snapshot for non-HF datasets and revamp checkpoint-resume UX/flow
…nd-ui-for-training Track multi-dataset downloads in training startup
…isplay-format Support dataset snapshots without worker manifest; resume-checkpoint payload & training-start fixes
…isplay-format-tkxrz7 Preserve checkpoint max_steps on resume; resume payload and snapshot completion improvements
…ue-with-hugging-face Restore training status after checkpoint uploads, ignore completed tqdm bars, and simplify dataset UI state
…rror Preserve checkpoint upload prefs, suppress misleading upload events, and stabilize continuation naming
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.