You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The data_path_prefix in dexbotic/data/data_source/*_official.py files uses singular video directory name, while the conversion scripts (convert_rlds_to_dexdata.py and convert_lerobot_to_dexdata.py) output to plural videos/ directory. Additionally, the JSON output directory naming is inconsistent: conversion scripts output to jsonl/ but data_source configs
expected various directory names. Although dex_dataset.py uses recursive search to find .jsonl files, unified naming convention is still preferable for consistency. This inconsistency causes path
mismatch during training.
Root Cause
Conversion scripts output to videos/ but data_source configs expected video/
Conversion scripts output to jsonl/ but data_source configs expected various naming conventions
Technical Evidence
In dexbotic/data/dataset/transform/multimodal.py:123, video paths are resolved by joining data_path_prefix with frame['url']:
Problem
The
data_path_prefixindexbotic/data/data_source/*_official.pyfiles uses singularvideodirectory name, while the conversion scripts (convert_rlds_to_dexdata.pyandconvert_lerobot_to_dexdata.py) output to pluralvideos/directory. Additionally, the JSON output directory naming is inconsistent: conversion scripts output tojsonl/but data_source configsexpected various directory names. Although dex_dataset.py uses recursive search to find .jsonl files, unified naming convention is still preferable for consistency. This inconsistency causes path
mismatch during training.
Root Cause
videos/but data_source configs expectedvideo/jsonl/but data_source configs expected various naming conventionsTechnical Evidence
In
dexbotic/data/dataset/transform/multimodal.py:123, video paths are resolved by joiningdata_path_prefixwithframe['url']: