WIP

WIP

WIP train.py works, loss going down

WIP eval.py

Fix

WIP (eval running, TODO: verify results reproduced)

Eval works! (testing reproducibility)

WIP

pretrained model pusht reproduces same results as torchrl

pretrained model pusht reproduces same results as torchrl

Remove AbstractPolicy, Move all queues in select_action

WIP test_datasets passed (TODO: re-enable NormalizeTransform)

pyproject.toml

@@ -52,7 +52,10 @@ robomimic = "0.2.0"
 gymnasium-robotics = "^1.2.4"
 gymnasium = "^0.29.1"
 cmake = "^3.29.0.1"
+gym_pusht = { git = "git@github.com:huggingface/gym-pusht.git", optional = true}
 
+[tool.poetry.extras]
+pusht = ["gym_pusht"]
 
 [tool.poetry.group.dev.dependencies]
 pre-commit = "^3.6.2"