Skip to content

Add PPO critic lifecycle hooks and DistributionalPPO - #236

Open
samindaa wants to merge 1 commit into
leggedrobotics:mainfrom
samindaa:feat/distributional-ppo
Open

samindaa wants to merge 1 commit into
leggedrobotics:mainfrom
samindaa:feat/distributional-ppo

Conversation

@samindaa

Copy link
Copy Markdown
  • Extract compute_value_estimate() and compute_critic_loss() hooks in PPO
  • Allow configurable critic output_dim in PPO.construct_algorithm()
  • Add DistributionalPPO with quantile regression and Quantile Huber loss
  • Add unit tests for critic lifecycle hooks and DistributionalPPO

- Extract compute_value_estimate() and compute_critic_loss() hooks in PPO
- Allow configurable critic output_dim in PPO.construct_algorithm()
- Add DistributionalPPO with quantile regression and Quantile Huber loss
- Add unit tests for critic lifecycle hooks and DistributionalPPO
@samindaa
samindaa force-pushed the feat/distributional-ppo branch from 975cf0b to 64bdfda Compare October 8, 2026 01:53
@ClemensSchwarke

Copy link
Copy Markdown
Collaborator

Hi @samindaa,
are you planning this PR as something you want to contribute? I didn't find an open issue for it.
Thanks, Clemens

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants