KeWang1017 6db2154f28 Enhance SAC configuration and policy with new parameters and subsampling logic ...

- Added `num_subsample_critics`, `critic_target_update_weight`, and `utd_ratio` to SACConfig.
- Implemented target entropy calculation in SACPolicy if not provided.
- Introduced subsampling of critics to prevent overfitting during updates.
- Updated temperature loss calculation to use the new target entropy.
- Added comments for future UTD update implementation.

These changes improve the flexibility and performance of the SAC implementation.

2025-04-18 15:02:13 +02:00

..

datasets

Reward classifier and training (#528)

2025-04-18 15:02:13 +02:00

envs

Support for PI0+FAST (#921)

2025-04-04 11:51:11 +02:00

optim

chore(doc): add license header to all files (#818)

2025-03-05 17:56:51 +01:00

policies

Enhance SAC configuration and policy with new parameters and subsampling logic

2025-04-18 15:02:13 +02:00

robot_devices

Fixup

2025-04-18 15:02:13 +02:00

utils

[pre-commit.ci] pre-commit autoupdate (#871)

2025-04-08 06:58:46 +02:00

constants.py

chore(doc): add license header to all files (#818)

2025-03-05 17:56:51 +01:00

logger.py

Fixup

2025-04-18 15:02:13 +02:00