Writing
Longer writeups of what I'm working on — what worked, and what broke.
-
Skills, not steps
Flat RL never solves OGBench's long manipulation tasks, even after 40M steps. A library of small learned skills with a learned composer does. Where the difficulty actually goes, and the rewards that quietly paid the robot not to finish.