Commit Graph

Select branches

Hide Pull Requests

2025_04_11_vla_eval

Cadene-patch-1

alexander-soare/add_drop_last_keyframes

chore/bump_pythonversion_precommit

depth

feat/add_rerun

feat/autopolicy

fix/lint_warnings

fix_aloha_conversion_nan

fix_path

hf-papers

lerobot-xh

main

mindbotv1

my-fix-based-on-pr-1175

origin/fix/record_policy_action_dict

origin/user/rcadene/2024_04_30_refactor_push_dataset_to_hub_video

pre-commit-ci-update-config

qgallouedec-patch-1

qgallouedec/macos_ci

qgallouedec/move_update_optim_schedul_outside_policy

qgallouedec/use_pretrainedconfig

realman

realman-dual

realman-dual-arm

realman-dual-arm-bak

realman-dual-xh

realman-dual-yehao

realman-single-arm

recovered-commit

refactor/updated_api_docs_rebased

revert-1160-mshukor-patch-1

robot_client

smolvla_doc

tdmpc23

temp_branch_hil_serl

test/add_cameras_di_tests

test/add_cameras_di_tests_no_tmp_connect

test/add_cameras_patch_tests

test/add_cameras_patch_tests_no_tmp_connect

test/robot_refactor_experiments

thom-act

thom-fixes

thom-proposals

thom_arm

thomwolf_2024_06_04_nan_fixes

thomwolf_2024_06_04_nans

thomwolf_2024_06_04_simple_gym

thomwolf_2024_06_12_deep_dive_ACT

thomwolf_2024_06_18_fix_normalization

torchcodec-cpu

user/adil-zouitine/2025-1-7-port-hil-serl

user/adil-zouitine/2025-1-7-port-hil-serl-new

user/alexander/multistep_policy_rollout

user/aliberts/2024_03_15_notebook_example

user/aliberts/2024_03_16_update_torchrl

user/aliberts/2024_03_22_fix_simxarm

user/aliberts/2024_03_26_add_ci_tests

user/aliberts/2024_03_28_package_envs

user/aliberts/2024_03_31_fix_simxarm_render

user/aliberts/2024_05_06_add_coverage

user/aliberts/2024_05_07_dev_docker

user/aliberts/2024_05_12_add_metrics_logging_config

user/aliberts/2024_05_14_compare_policies

user/aliberts/2024_05_20_add_gym_dora

user/aliberts/2024_07_26_remove_dataset_artifacts

user/aliberts/2024_09_10_fix_docker_dev

user/aliberts/2025_02_25_refactor_robots

user/aliberts/2025_02_27_fix_pr_style_bot

user/aliberts/2025_03_08_register_configs

user/aliberts/2025_03_10_new_feetech_calibration

user/aliberts/2025_04_03_add_hope_jr

user/aliberts/2025_04_08_fix_install_instruction

user/aliberts/2025_04_19_refactor_cameras

user/aliberts/2025_06_02_cap_pymunk

user/azouitine/2025-04-24-hot-fix-ci

user/azouitine/2025-4-8-softmax-grasp-critic

user/fracapuano/2024-04-24-mocking-robots

user/fracapuano/2025-04-23-fixing-mock-robot

user/fracapuano/2025-04-23-predicting-chunks

user/fracapuano/2025_05_21_dataset_streaming

user/fracapuano/2025_05_29_dataset_streaming_delta_timesteps

user/fracapuano/async-inf

user/jmoss/2024_08_19_add_hiwonder_motors

user/marinabar/2024_06_10_evaluation_stats

user/michel-aractingi/2024-02-18-hilserl-cache-embedding

user/michel-aractingi/2024-02-21-hilserl-threading-to-mp

user/michel-aractingi/2024-08-26-tdmpc2-implementation

user/michel-aractingi/2024-09-02/move-make-optimizer-to-policy

user/michel-aractingi/2024-10-15-control-sim

user/michel-aractingi/2024-11-20-new-tdmpc2-impl

user/michel-aractingi/2024-11-26-Maniskill-support

user/michel-aractingi/2024-11-27-port-hil-serl

user/michel-aractingi/2024-12-06-sac-implementation

user/michel-aractingi/2024-12-07-soft-actor-critic

user/michel-aractingi/2025-01-18-port-rlds-example

user/michel-aractingi/2025-01-21-server-client-arch

user/michel-aractingi/2025-05-20-hil-rebase-robots

user/michel-aractingi/2025-06-02-docs-for-hil-serl

user/michel-aractingi/tmp-hil-serl-rebase

user/michel-aractingi/tmp-port-hil-serl-new

user/michel_adil/dump_hil_serl

user/michel_aractingi/2024-04-04-grasp-critic

user/mrussi/2025_01_09_hope_junior

user/mrussi/2025_04_12_hopejr

user/mshukor/2025_02_25_accelerate

user/pepijn/2025_01_24_save_autocorrect_calibration_to_json

user/pepijn/2025_01_27_steps_assembly_intructions

user/pepijn/2025_03_11_focal_loss

user/pepijn/2025_03_11_weighted_sampling

user/pepijn/2025_03_18_fix_rotation_so100_docs

user/pepijn/2025_03_20_dana_workshop

user/pepijn/2025_05_05_lekiwi_dual_teleop

user/rcadene/2024_03_04_diffusion_pretrained_from_repo

user/rcadene/2024_03_04_sbatch_hopper

user/rcadene/2024_03_08_act_policy

user/rcadene/2024_03_11_aloha_load_pretrained_from_act_repo

user/rcadene/2024_03_14_video_dataset

user/rcadene/2024_03_22_pretrained

user/rcadene/2024_03_25_readme

user/rcadene/2024_03_31_pretrained_models_aloha_simxarm

user/rcadene/2024_04_20_mobile_aloha_rerun

user/rcadene/2024_04_30_refactor_push_dataset_to_hub_video

user/rcadene/2024_05_08_test

user/rcadene/2024_05_20_dora_parquet_format_viz

user/rcadene/2024_06_01_custom_visualize_dataset

user/rcadene/2024_06_03_fix_delta_timestamps

user/rcadene/2024_06_03_reachy2

user/rcadene/2024_06_07_faster_act

user/rcadene/2024_06_08_add_data_augmentation

user/rcadene/2024_06_22_control_robot_other

user/rcadene/2024_07_09_bill_of_materials

user/rcadene/2024_07_16_control_robot_v2_aloha

user/rcadene/2024_07_16_vqbet_multi_images

user/rcadene/2024_07_26_control_robot_v2_train

user/rcadene/2024_07_27_nightly

user/rcadene/2024_07_29_control_robot_linux

user/rcadene/2024_08_06_improve_visualize_dataset_inference

user/rcadene/2024_08_22_control_aloha

user/rcadene/2024_08_24_edit_dataset_remove_episodes

user/rcadene/2024_09_10_train_aloha_debug

user/rcadene/2024_09_18_async_inference

user/rcadene/2024_10_24_feetech_dataset_v2

user/rcadene/2024_11_26_hope_junior

user/rcadene/2024_11_27_reachy2_viz_inference

user/rcadene/2024_12_03_manage_dataset

user/rcadene/2025_01_28_aloha_hdf5

user/rcadene/2025_02_07_improve_pi0

user/rcadene/2025_02_17_streaming

user/rcadene/2025_02_17_visualize_inference

user/rcadene/2025_02_19_port_openx

user/rcadene/2025_04_11_dataset_v3

user/youliang/2024_06_20_oxe_data_format_to_hg

#10

#1001

#1002

#1006

#1006

#1008

#1008

#1009

#101

#1011

#1014

#1014

#1016

#1017

#1018

#1020

#1020

#1021

#1022

#1023

#1024

#1024

#1025

#1027

#1028

#1029

#103

#1030

#1031

#1031

#1034

#1035

#1035

#1036

#1036

#1037

#1037

#1040

#1040

#1046

#1047

#1047

#1048

#1051

#1052

#1052

#1053

#1053

#1054

#1055

#1055

#1056

#1056

#1057

#1057

#106

#1060

#1060

#1062

#1062

#1063

#1064

#1067

#107

#1070

#1073

#1074

#1075

#1076

#1077

#108

#1081

#1087

#1089

#109

#1092

#1092

#11

#110

#1103

#1104

#1108

#111

#1112

#1113

#1113

#1115

#1117

#1120

#1120

#1122

#1123

#1125

#1127

#1128

#1128

#113

#1131

#1132

#1132

#1133

#1134

#1136

#1137

#1138

#1138

#1139

#114

#1140

#1141

#1143

#1146

#1148

#1149

#1149

#115

#1150

#1150

#1151

#1151

#1152

#1154

#1155

#1156

#1157

#1158

#1158

#1159

#116

#1160

#1162

#1163

#1164

#1165

#1165

#1167

#1168

#117

#1172

#1172

#1173

#1173

#1175

#1178

#118

#1181

#1182

#1183

#1184

#1185

#1185

#1187

#1187

#1188

#119

#1190

#1191

#1192

#1193

#1194

#1196

#1196

#1197

#1197

#1198

#1198

#12

#120

#1200

#1200

#1201

#1201

#121

#122

#123

#124

#125

#126

#127

#128

#129

#13

#130

#131

#132

#133

#134

#135

#136

#137

#138

#138

#139

#14

#140

#144

#145

#146

#147

#148

#149

#15

#150

#151

#153

#154

#154

#155

#157

#158

#16

#160

#161

#162

#163

#163

#164

#165

#166

#169

#17

#171

#172

#174

#175

#176

#177

#179

#18

#181

#181

#182

#184

#184

#185

#186

#188

#189

#19

#190

#191

#192

#193

#195

#196

#197

#198

#199

#2

#20

#200

#201

#202

#203

#204

#205

#206

#207

#208

#209

#209

#21

#210

#213

#215

#216

#217

#218

#219

#22

#220

#221

#222

#223

#224

#225

#225

#228

#229

#23

#230

#231

#232

#233

#234

#235

#236

#237

#239

#240

#241

#242

#242

#243

#244

#245

#245

#246

#247

#249

#25

#252

#253

#254

#257

#26

#260

#262

#262

#264

#265

#267

#268

#269

#27

#270

#271

#272

#272

#273

#275

#276

#277

#278

#279

#28

#280

#281

#281

#282

#283

#284

#286

#288

#29

#290

#290

#292

#295

#298

#299

#3

#30

#300

#301

#302

#303

#306

#307

#308

#309

#31

#310

#312

#314

#316

#317

#317

#318

#319

#32

#322

#323

#325

#326

#327

#328

#329

#329

#33

#330

#331

#332

#333

#337

#338

#339

#340

#343

#344

#344

#345

#346

#347

#349

#349

#35

#350

#350

#351

#353

#353

#354

#355

#356

#356

#357

#358

#359

#36

#361

#362

#363

#364

#364

#365

#37

#370

#371

#372

#372

#373

#375

#376

#378

#378

#379

#38

#380

#380

#381

#381

#382

#384

#385

#386

#387

#388

#389

#39

#391

#391

#392

#392

#395

#396

#397

#398

#399

#4

#40

#400

#401

#401

#402

#403

#404

#409

#41

#410

#411

#411

#412

#414

#415

#416

#417

#418

#419

#42

#420

#422

#423

#424

#426

#428

#428

#429

#430

#431

#433

#434

#437

#437

#44

#442

#443

#445

#445

#447

#447

#448

#45

#450

#453

#455

#455

#457

#457

#459

#459

#46

#460

#461

#463

#464

#465

#465

#466

#467

#468

#47

#471

#473

#476

#476

#479

#48

#480

#481

#481

#482

#484

#485

#486

#487

#487

#488

#489

#49

#490

#491

#493

#493

#494

#495

#498

#499

#5

#50

#503

#505

#506

#506

#507

#507

#508

#512

#513

#514

#516

#516

#518

#519

#519

#521

#522

#523

#523

#524

#528

#529

#529

#53

#531

#531

#535

#535

#539

#54

#540

#541

#543

#543

#546

#548

#548

#550

#551

#551

#554

#556

#557

#558

#559

#56

#562

#563

#565

#565

#566

#567

#569

#569

#57

#570

#572

#573

#576

#577

#577

#578

#579

#58

#580

#581

#583

#584

#586

#586

#587

#588

#589

#590

#591

#591

#592

#592

#593

#594

#595

#598

#599

#6

#60

#600

#601

#602

#603

#604

#609

#610

#612

#614

#615

#616

#617

#618

#619

#620

#621

#622

#626

#627

#628

#628

#629

#63

#631

#634

#637

#637

#639

#64

#640

#641

#642

#643

#644

#644

#645

#645

#646

#647

#648

#649

#65

#651

#653

#654

#655

#656

#657

#657

#658

#659

#659

#66

#660

#662

#663

#664

#665

#666

#667

#668

#669

#67

#670

#675

#676

#677

#68

#680

#680

#681

#682

#682

#684

#684

#688

#69

#690

#691

#691

#693

#695

#696

#697

#7

#70

#701

#702

#703

#703

#704

#704

#708

#709

#71

#710

#711

#712

#714

#715

#716

#719

#72

#720

#722

#724

#725

#726

#728

#729

#729

#73

#730

#731

#732

#733

#734

#737

#739

#739

#74

#740

#740

#743

#744

#744

#747

#747

#75

#751

#752

#753

#754

#756

#756

#757

#758

#758

#759

#76

#760

#760

#762

#763

#765

#766

#767

#767

#768

#768

#77

#770

#772

#774

#775

#776

#777

#777

#778

#778

#780

#781

#782

#783

#784

#785

#786

#787

#79

#790

#791

#791

#792

#793

#794

#794

#795

#796

#798

#799

#8

#80

#800

#801

#803

#804

#807

#809

#81

#810

#811

#812

#814

#815

#818

#82

#820

#820

#824

#824

#827

#829

#83

#830

#831

#831

#832

#833

#834

#834

#835

#835

#838

#839

#84

#840

#841

#842

#843

#844

#845

#848

#85

#855

#856

#857

#859

#86

#861

#863

#865

#866

#866

#868

#869

#87

#870

#871

#872

#872

#873

#873

#874

#874

#875

#877

#878

#878

#88

#880

#880

#882

#882

#883

#885

#885

#886

#887

#889

#89

#891

#893

#896

#897

#899

#899

#9

#90

#900

#902

#902

#903

#907

#908

#91

#911

#913

#913

#914

#915

#917

#918

#92

#921

#922

#924

#924

#925

#929

#931

#931

#934

#935

#935

#936

#937

#939

#94

#943

#943

#944

#945

#945

#946

#947

#948

#95

#950

#953

#954

#957

#958

#96

#962

#965

#965

#966

#967

#967

#969

#969

#97

#972

#972

#974

#974

#976

#977

#978

#98

#980

#983

#984

#984

#986

#986

#987

#988

#989

#99

#990

#991

#992

#993

#994

#995

#995

#998

#999

Mono Color

• 6a215f47dd Refactor SAC configuration and policy to support discrete actions AdilZouitine 2025-04-01 09:30:32 +00:00
• fe2ff516a8 Added Gripper quantization wrapper and grasp penalty removed complementary info from buffer and learner server removed get_gripper_action function added gripper parameters to common/envs/configs.py Michel Aractingi 2025-04-01 11:08:15 +02:00
• 65569ba90e Add test_scan_port (TODO) Simon Alibert 2025-03-31 18:40:23 +02:00
• 79293800f1 Implement Koch calibration Simon Alibert 2025-03-31 18:18:27 +02:00
• bc765f9e95 Implement SO-100 follower calibration Simon Alibert 2025-03-31 18:17:20 +02:00
• 201311503f Implement SO-100 leader calibration Simon Alibert 2025-03-31 18:16:42 +02:00
• 8cc0232e73 Format baudrate tables Simon Alibert 2025-03-31 18:14:57 +02:00
• 6bfcc18e73 Add more calibration utilities Simon Alibert 2025-03-31 18:14:11 +02:00
• 7983baf4fc [pre-commit.ci] auto fixes from pre-commit.com hooks pre-commit-ci[bot] 2025-03-31 16:10:00 +00:00
• c774bbe522 Add grasp critic to the training loop s1lent4gnt 2025-03-31 18:06:21 +02:00
• 2c1e5fa28b Add get_gripper_action method to GamepadController s1lent4gnt 2025-03-31 17:40:00 +02:00
• 7452f9baaa Add gripper penalty wrapper s1lent4gnt 2025-03-31 17:38:16 +02:00
• 007fee9230 Add complementary info in the replay buffer s1lent4gnt 2025-03-31 17:36:35 +02:00
• 4a1c26d9ee Add grasp critic s1lent4gnt 2025-03-31 17:35:59 +02:00
• 0f706ce543 [pre-commit.ci] auto fixes from pre-commit.com hooks pre-commit-ci[bot] 2025-03-31 13:59:31 +00:00
• 026ad463a9 Fix convergence of sac, multiple torch compile on the same model caused divergence AdilZouitine 2025-03-31 13:54:21 +00:00
• 8494634d48 Fix cuda graph break AdilZouitine 2025-03-31 07:59:56 +00:00
• e004247ed4 docs: add tip for Mac users regarding Terminal permissions for keyboard (#917) Mariusz Dubielecki 2025-03-31 18:44:05 +11:00
• 66c3672738 Fix: Prevent Invalid next_state References When optimize_memory=True (#918) s1lent4gnt 2025-03-31 09:43:40 +02:00
• 53ecec5fb2 WIP v21 to v30 user/rcadene/2025_02_19_port_openx Remi Cadene 2025-03-31 07:38:01 +00:00
• e096754d14 Rename test Simon Alibert 2025-03-31 00:41:25 +02:00
• 02803f545d Add test_encoding_utils Simon Alibert 2025-03-31 00:37:28 +02:00
• 8503e8e166 Move encoding functions to encoding_utils Simon Alibert 2025-03-31 00:35:31 +02:00
• d6007c6e7d Add calibration utilities Simon Alibert 2025-03-30 15:41:39 +02:00
• 50963fcf13 Add scan_port utility Simon Alibert 2025-03-30 15:32:25 +02:00
• c05e4835d0 [pre-commit.ci] auto fixes from pre-commit.com hooks pre-commit-ci[bot] 2025-03-28 17:20:38 +00:00
• 808cf63221 Added support for controlling the gripper with the pygame interface of gamepad Minor modifications in gym_manipulator to quantize the gripper actions clamped the observations after F.resize in ConvertToLeRobotObservation wrapper due to a bug in F.resize, images were returned exceeding the maximum value of 1.0 Michel Aractingi 2025-03-28 18:12:03 +01:00
• 0150139668 Refactor SACPolicy for improved type annotations and readability AdilZouitine 2025-03-28 16:46:21 +00:00
• b3ad63cf6e Refactor SACPolicy and learner_server for improved clarity and functionality AdilZouitine 2025-03-28 16:40:45 +00:00
• 8b02e81bb5 Refactor actor_server.py for improved structure and logging AdilZouitine 2025-03-28 14:17:16 +00:00
• dcce446a66 Refactor learner_server.py for improved structure and clarity AdilZouitine 2025-03-28 13:28:47 +00:00
• 82a6b69e0e Refactor imports in modeling_sac.py for improved organization AdilZouitine 2025-03-28 13:26:47 +00:00
• 6f7024242a Refactor SACConfig properties for improved readability AdilZouitine 2025-03-28 13:26:31 +00:00
• 3c56ad33c3 fix AdilZouitine 2025-03-28 10:51:32 +00:00
• 49baa1ff49 Enhance logging for actor and learner servers AdilZouitine 2025-03-28 10:43:03 +00:00
• 02b9ea9446 Added gripper control mechanism to gym_manipulator Moved HilSerl env config to configs/env/configs.py fixes in actor_server and modeling_sac and configuration_sac added the possibility of ignoring missing keys in env_cfg in get_features_from_env_config function Michel Aractingi 2025-03-28 08:21:36 +01:00
• 79e0f6e06c Add WrapperConfig for environment wrappers and update SACConfig properties AdilZouitine 2025-03-27 17:07:06 +00:00
• d0b7690bc0 Change HILSerlRobotEnvConfig to inherit from EnvConfig Added support for hil_serl classifier to be trained with train.py run classifier training by python lerobot/scripts/train.py --policy.type=hilserl_classifier fixes in find_joint_limits, control_robot, end_effector_control_utils Michel Aractingi 2025-03-27 10:23:14 +01:00
• 052a4acfc2 [WIP] Update SAC configuration and environment settings AdilZouitine 2025-03-27 08:13:20 +00:00
• 626e5dd35c Add wandb run id in config AdilZouitine 2025-03-27 08:11:56 +00:00
• dd37bd412e [WIP] Non functional yet Add ManiSkill environment configuration and wrappers AdilZouitine 2025-03-26 08:15:05 +00:00
• b7b6d8102f Change config logic in: - gym_manipulator - find_joint_limits - end_effector_utils Michel Aractingi 2025-03-25 14:24:46 +01:00
• ee25fd8afe Add .devcontainer to .gitignore for improved development environment management AdilZouitine 2025-03-25 08:21:07 +00:00
• 5fbbc65869 Add task field to frame_dict in ReplayBuffer and simplify save_episode calls AdilZouitine 2025-03-24 20:28:14 +00:00
• f483931fc0 Handle new config with sac AdilZouitine 2025-03-24 20:19:28 +00:00
• b2025b852c Handle multi optimizers AdilZouitine 2025-03-24 15:34:30 +00:00
• 7c05755823 [pre-commit.ci] auto fixes from pre-commit.com hooks pre-commit-ci[bot] 2025-03-24 13:41:27 +00:00
• 2945bbb221 Removed depleted files and scripts Michel Aractingi 2025-03-24 14:41:01 +01:00
• 8e6d5f504c [pre-commit.ci] auto fixes from pre-commit.com hooks pre-commit-ci[bot] 2025-03-24 13:16:38 +00:00
• 761a2dbcb3 Update tensor device assignment in ReplayBuffer class AdilZouitine 2025-03-21 14:21:31 +00:00
• 81952b2092 [pre-commit.ci] auto fixes from pre-commit.com hooks pre-commit-ci[bot] 2025-03-20 12:58:43 +00:00
• 0eef49a0f6 Initialize log_alpha with the logarithm of temperature_init in SACPolicy AdilZouitine 2025-03-20 12:55:22 +00:00
• 2d5effeeba [pre-commit.ci] auto fixes from pre-commit.com hooks pre-commit-ci[bot] 2025-03-19 18:53:26 +00:00
• c5c921cd7c Remove unused functions and imports from modeling_sac.py AdilZouitine 2025-03-19 18:53:01 +00:00
• 80e766c05c Add intervention rate tracking in act_with_policy function AdilZouitine 2025-03-19 18:37:50 +00:00
• eb6787e159 - Updated the logging condition to use log_freq directly instead of accessing it through cfg.training.log_freq for improved readability and speed. AdilZouitine 2025-03-19 13:40:23 +00:00
• 659adfc743 [PORT HIL-SERL] Optimize training loop, extract config usage (#855) Eugene Mironov 2025-03-19 20:27:32 +07:00
• 07cc0662da Enhance training information logging in learner server AdilZouitine 2025-03-19 13:16:31 +00:00
• a02195249f Update configuration files for improved performance and flexibility AdilZouitine 2025-03-19 09:54:46 +00:00
• cb272294f5 [pre-commit.ci] auto fixes from pre-commit.com hooks pre-commit-ci[bot] 2025-03-18 14:57:57 +00:00
• 4bb2077afa Refactor SACPolicy and learner server for improved replay buffer management AdilZouitine 2025-03-18 14:57:15 +00:00
• b82faf7d8c Add end effector action space to hil-serl (#861) Michel Aractingi 2025-03-17 14:22:33 +01:00
• 7960f2c3c1 Enhance SAC configuration and policy with gradient clipping and temperature management AdilZouitine 2025-03-17 10:50:28 +00:00
• dee154a1a5 [pre-commit.ci] auto fixes from pre-commit.com hooks pre-commit-ci[bot] 2025-03-12 10:16:54 +00:00
• a3ef7dc6c3 Add custom save and load methods for SAC policy AdilZouitine 2025-03-12 10:15:37 +00:00
• 7e3e1ce173 Remove torch.no_grad decorator and optimize next action prediction in SAC policy AdilZouitine 2025-03-10 10:31:38 +00:00
• 83b2dc1219 [Port HIL-SERL] Balanced sampler function speed up and refactor to align with train.py (#715) s1lent4gnt 2025-03-12 10:35:30 +01:00
• db78fee9de [HIL-SERL] Migrate threading to multiprocessing (#759) Eugene Mironov 2025-03-05 17:19:31 +07:00
• 38f5fa4523 [pre-commit.ci] auto fixes from pre-commit.com hooks pre-commit-ci[bot] 2025-03-04 13:38:47 +00:00
• 76df8a31b3 Add storage device configuration for SAC policy and replay buffer AdilZouitine 2025-03-04 13:22:35 +00:00
• 24f93c755a Add memory optimization option to ReplayBuffer AdilZouitine 2025-02-25 19:04:58 +00:00
• 20fee3d043 Add storage device parameter to replay buffer initialization AdilZouitine 2025-02-25 15:30:39 +00:00
• 7c366e3223 Refactor ReplayBuffer with tensor-based storage and improved sampling efficiency AdilZouitine 2025-02-25 14:26:44 +00:00
• 2c799508d7 Update ManiSkill configuration and replay buffer to support truncation and dataset handling AdilZouitine 2025-02-24 16:53:37 +00:00
• ff223c106d Added caching function in the learner_server and modeling sac in order to limit the number of forward passes through the pretrained encoder when its frozen. Added tensordict dependencies Updated the version of torch and torchvision Michel Aractingi 2025-02-21 10:13:43 +00:00
• d48161da1b [Port HIL-SERL] Adjust Actor-Learner architecture & clean up dependency management for HIL-SERL (#722) Eugene Mironov 2025-02-21 16:29:00 +07:00
• 150def839c Refactor SAC policy with performance optimizations and multi-camera support AdilZouitine 2025-02-20 17:14:27 +00:00
• 795063aa1b - Fixed big issue in the loading of the policy parameters sent by the learner to the actor -- pass only the actor to the update_policy_parameters and remove strict=False - Fixed big issue in the normalization of the actions in the forward function of the critic -- remove the torch.no_grad decorator in normalize.py in the normalization function - Fixed performance issue to boost the optimization frequency by setting the storage device to be the same as the device of learning. Michel Aractingi 2025-02-19 16:22:51 +00:00
• d9cd85d976 Re-enable parameter push thread in learner server AdilZouitine 2025-02-17 10:26:33 +00:00
• 279e03b6c8 Improve wandb logging and custom step tracking in logger AdilZouitine 2025-02-17 10:08:49 +00:00
• b7a0ffc3b8 Add maniskill support. Co-authored-by: Michel Aractingi <michel.aractingi@gmail.com> AdilZouitine 2025-02-14 19:53:29 +00:00
• 291358d6a2 Fixed bug in the action scale of the intervention actions and offline dataset actions. (scale by inverse delta) Michel Aractingi 2025-02-14 15:17:16 +01:00
• 2aca830a09 Modified crop_dataset_roi interface to automatically write the cropped parameters to a json file in the meta of the dataset Michel Aractingi 2025-02-14 12:32:45 +01:00
• 2f34d84298 Optimized the replay buffer from the memory side to store data on cpu instead of a gpu device and send the batches to the gpu. Michel Aractingi 2025-02-13 18:03:57 +01:00
• 61b0e9539f nit Michel Aractingi 2025-02-13 17:12:57 +01:00
• 23c6b891a3 removed uncomment in actor server Michel Aractingi 2025-02-13 16:53:33 +01:00
• 0847b2119b Changed the init_final value to center the starting mean and std of the policy Michel Aractingi 2025-02-13 16:42:43 +01:00
• 24fb8a7f47 Changed bounds for a new so100 robot Michel Aractingi 2025-02-13 15:43:30 +01:00
• eb7e28d9d9 Hardcoded some normalization parameters. TODO refactor Added masking actions on the level of the intervention actions and offline dataset Michel Aractingi 2025-02-13 14:27:14 +01:00
• a0e0a9a9b1 fix log_alpha in modeling_sac: change to nn.parameter added pretrained vision model in policy Michel Aractingi 2025-02-13 11:26:24 +01:00
• 57e09828ce Added logging for interventions to monitor the rate of interventions through time Added an s keyboard command to force success in the case the reward classifier fails Michel Aractingi 2025-02-13 11:04:49 +01:00
• 9c14830cd9 Added possiblity to record and replay delta actions during teleoperation rather than absolute actions Michel Aractingi 2025-02-12 19:25:41 +01:00
• 4057904238 [PORT-Hilserl] classifier fixes (#695) Yoel 2025-02-11 11:39:17 +01:00
• 3c58867738 [Port HIL-SERL] Add resnet-10 as default encoder for HIL-SERL (#696) Eugene Mironov 2025-02-11 17:37:00 +07:00
• c623824139 - Added JointMaskingActionSpace wrapper in gym_manipulator in order to select which joints will be controlled. For example, we can disable the gripper actions for some tasks. - Added Nan detection mechanisms in the actor, learner and gym_manipulator for the case where we encounter nans in the loop. - changed the non-blocking in the .to(device) functions to only work for the case of cuda because they were causing nans when running the policy on mps - Added some joint clipping and limits in the env, robot and policy configs. TODO clean this part and make the limits in one config file only. Michel Aractingi 2025-02-11 11:34:46 +01:00
• 3cb43f801c Added sac_real config file in the policym configs dir. Co-authored-by: Adil Zouitine <adilzouitinegm@gmail.com> Michel Aractingi 2025-02-10 16:08:13 +01:00
• f4f5b26a21 Several fixes to move the actor_server and learner_server code from the maniskill environment to the real robot environment. Michel Aractingi 2025-02-10 16:03:39 +01:00
• 434d1e0614 [HIL-SERL port] Add Reward classifier benchmark tracking to chose best visual encoder (#688) Eugene Mironov 2025-02-07 00:39:51 +07:00
• 729b4ed697 - Added lerobot/scripts/server/gym_manipulator.py that contains all the necessary wrappers to run a gym-style env around the real robot. - Added lerobot/scripts/server/find_joint_limits.py to test the min and max angles of the motion you wish the robot to explore during RL training. - Added logic in manipulator.py to limit the maximum possible joint angles to allow motion within a predefined joint position range. The limits are specified in the yaml config for each robot. Checkout the so100.yaml. Michel Aractingi 2025-02-06 16:29:37 +01:00
• 163bcbcad4 fixed bug in crop_dataset_roi.py added missing buffer.pt in server dir Michel Aractingi 2025-02-05 18:22:50 +00:00