Cache github token and cleanup