[CI] Hopefully fix build

It's possible that pygame is being installed for root, but not for
anyone else?