Commit Graph

59 Commits

Author SHA1 Message Date
Simon Alibert
6ad84a6561 Refactor pusht_zarr 2024-11-25 18:23:04 +01:00
Simon Alibert
23f6c875b5 Apply suggestions from code review 2024-11-25 12:44:12 +01:00
Simon Alibert
c6ad495176 Enhance dataset cards 2024-11-20 11:57:27 +01:00
Simon Alibert
6203641710 Use HWC for images 2024-11-19 18:48:17 +01:00
Remi
1f13bda25b Improve dataset v2 (#498) 2024-11-19 12:31:47 +01:00
Simon Alibert
a91b7c6163 Add extra info to dataset card, various fixes from Remi's review 2024-11-18 17:50:13 +01:00
Simon Alibert
f3630ad910 Fix tests 2024-11-05 19:09:12 +01:00
Simon Alibert
aed9f4036a Refactor dataset features 2024-11-05 13:10:43 +01:00
Simon Alibert
e4ba084e25 Add LeRobotDatasetMetadata 2024-11-03 18:07:37 +01:00
Simon Alibert
6b2ec1ed77 Add test_image_writer, accept PIL images, improve ImageWriter perf in main process 2024-11-02 20:00:07 +01:00
Simon Alibert
79d114cc1f Rename num_samples -> num_frames for consistency 2024-11-01 19:47:16 +01:00
Simon Alibert
c70b8d0abc Update doc 2024-10-31 14:08:13 +01:00
Simon Alibert
e1845d4dcc Update doc 2024-10-31 14:06:54 +01:00
Simon Alibert
e69f0c5059 Add test_delta_timestamps.py 2024-10-31 13:48:40 +01:00
Simon Alibert
fee5fa5c2e Remove image_writer arg 2024-10-29 16:07:10 +01:00
Simon Alibert
4c22de20a6 Add sanity check 2024-10-28 12:26:07 +01:00
Simon Alibert
51e87f6f97 Fix image writer 2024-10-28 12:01:32 +01:00
Simon Alibert
e210d795de Add video_info, fix image_writer 2024-10-25 16:55:33 +02:00
Simon Alibert
18ffa4248b Add json/jsonl io functions 2024-10-24 11:49:53 +02:00
Simon Alibert
450eae310b Add error msg 2024-10-24 00:13:53 +02:00
Simon Alibert
60865e8980 Allow dataset creation without robot 2024-10-24 00:13:21 +02:00
Simon Alibert
0d77be90ee Move ImageWriter creation inside the dataset 2024-10-23 23:12:44 +02:00
Simon Alibert
0098bd264e Nits 2024-10-23 20:55:54 +02:00
Simon Alibert
1aba80d93f Fix consolidate 2024-10-23 18:45:59 +02:00
Simon Alibert
07570f867f Fix _query_videos return shapes 2024-10-23 18:18:28 +02:00
Simon Alibert
a2a8538ac9 add write_stats, changes names, add some typing 2024-10-23 11:38:07 +02:00
Simon Alibert
fb73cdb9a4 Update dataset doc 2024-10-23 00:32:28 +02:00
Simon Alibert
9dca233d7e Fix episode chunk 2024-10-23 00:27:14 +02:00
Simon Alibert
c72dc23c43 Remove total_episodes from default parquet path 2024-10-23 00:03:30 +02:00
Simon Alibert
237a484be0 Fix paths & add add_frame doc 2024-10-22 22:46:34 +02:00
Simon Alibert
a805458c7e Add local_files_only, encode_videos, fix bugs to pass tests (WIP) 2024-10-22 19:57:52 +02:00
Simon Alibert
e991a31061 Improve consistency between __init__() and create(), WIP on consolidate 2024-10-22 00:19:25 +02:00
Simon Alibert
c4c0a43de7 add delete_episode, WIP on consolidate 2024-10-21 20:10:13 +02:00
Simon Alibert
299451af81 Add add_episode & task logic 2024-10-21 19:30:20 +02:00
Simon Alibert
c1232a01e2 Add add_frame, empty dataset creation 2024-10-21 00:16:52 +02:00
Simon Alibert
9316cf46ef Add file paths 2024-10-20 14:00:19 +02:00
Simon Alibert
ac3798bd62 Move default paths, use jsonlines for tasks 2024-10-18 17:53:25 +02:00
Simon Alibert
1a51505ec6 Add download_metadata, move default paths 2024-10-18 14:48:34 +02:00
Simon Alibert
be64d54bd9 Update doc 2024-10-18 00:29:50 +02:00
Simon Alibert
8bd406e607 Add suggestions from code review 2024-10-11 18:52:11 +02:00
Simon Alibert
3ea53124e0 Add padding keys and download_data option 2024-10-11 17:38:47 +02:00
Simon Alibert
7f680886b0 Add huggingface-hub patch for offline snapshot_download with local_dir 2024-10-11 11:03:11 +02:00
Simon Alibert
6d2bc11365 Add doc, scrap video_frame_keys attribute 2024-10-11 10:59:38 +02:00
Simon Alibert
b417cebc4e Update LeRobotDataset.__get_item__ 2024-10-10 21:32:14 +02:00
Simon Alibert
096824b5ff Rework LeRobotDataset.__init__ 2024-10-09 14:33:26 +02:00
Simon Alibert
0b21210d72 Convert datasets to av1 encoding (#302) 2024-07-22 20:08:59 +02:00
Simon Alibert
8865e19c12 Fix datasets missing versions (#318) 2024-07-16 23:02:31 +02:00
Alexander Soare
a4d77b99f0 Include observation.environment_state with keypoints in PushT dataset (#303)
Co-authored-by: Remi <re.cadene@gmail.com>
2024-07-09 08:27:40 +01:00
Simon Alibert
2abef3bef9 Enable video_reader backend (#220)
Co-authored-by: Alexander Soare <alexander.soare159@gmail.com>
2024-06-19 17:15:25 +02:00
Marina Barannikov
ff8f6aa6cd Add data augmentation in LeRobotDataset (#234)
Co-authored-by: Simon Alibert <alibert.sim@gmail.com>
Co-authored-by: Remi Cadene <re.cadene@gmail.com>
2024-06-11 19:20:55 +02:00