Get Color Joy 2 to work

Fixes most issues in the Color Joy 2 game. Performance is still not satisfying and needs further investigation.
Nit: use `break` instead of `continue` to be consistent with the other ways we end branch here. I checked to make sure that this didn't do anything different from the `break`s.