It's not all fun and games, though: we found the RL training quite hard to stabilize, and we document a few things we tried (e.g., DPPO, larger group sizes). I think there's still a lot more to do…