hangX/lerobot
1
0
Fork 0
forked from tangger/lerobot
Code Pull Requests Activity

Add huggingface-hub patch for offline snapshot_download with local_dir

Browse Source
This commit is contained in:
Simon Alibert
2024-10-11 11:03:11 +02:00
parent 6d2bc11365
commit 7f680886b0
3 changed files with 824 additions and 692 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
lerobot/common/datasets/lerobot_dataset.py
View File

@@ -178,9 +178,6 @@ class LeRobotDataset(torch.utils.data.Dataset):
will only download those episodes (selected by their episode_index). If 'episodes' is None, the whole
dataset will be downloaded. Thanks to the behavior of snapshot_download, if the files are already present
in 'local_dir', they won't be downloaded again.
Note: Currently, if you're running this code offline but you already have the files in 'local_dir',
snapshot_download will still fail. This behavior will be fixed in an upcoming update of huggingface_hub.
"""
# TODO(rcadene, aliberts): implement faster transfer
# https://huggingface.co/docs/huggingface_hub/en/guides/download#faster-downloads