Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

Preserve TabM backbone_params in TorchUniversalModel#176

Open
tippered1-debug wants to merge 1 commit into
sb-ai-lab:mastersb-ai-lab/LightAutoML:masterfrom
tippered1-debug:fix-tabm-backbone-paramstippered1-debug/LightAutoML:fix-tabm-backbone-paramsCopy head branch name to clipboard
Open

Preserve TabM backbone_params in TorchUniversalModel#176
tippered1-debug wants to merge 1 commit into
sb-ai-lab:mastersb-ai-lab/LightAutoML:masterfrom
tippered1-debug:fix-tabm-backbone-paramstippered1-debug/LightAutoML:fix-tabm-backbone-paramsCopy head branch name to clipboard

Conversation

@tippered1-debug

Copy link
Copy Markdown

Fixes TabM parameter propagation.

TorchUniversalModel was overwriting backbone_params when adding start_scaling_init_chunks. Because of that, user-provided TabM params like k, d_block, n_blocks, dropout, and arch_type could be ignored.

This PR preserves the existing backbone_params and only adds start_scaling_init_chunks.

It also makes the TabM batch sampler read k from backbone_params, so the sampler uses the same ensemble size as the TabM model.

Added tests for preserving backbone_params and reading TabM k correctly.

Checks run:

.venv/bin/python -m pytest tests/unit/test_automl/test_presets/test_tabularautoml_tabm.py -q -k "preserves_backbone_params or uses_tabm_k"
.venv/bin/python -m py_compile lightautoml/text/nn_model.py lightautoml/ml_algo/dl_model.py tests/unit/test_automl/test_presets/test_tabularautoml_tabm.py
git diff --check

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

Morty Proxy This is a proxified and sanitized view of the page, visit original site.