We need to explicitly ask for closed milestones, because there is no 'all the milestones' option. Otherwise we try create an existing milestone and GitHub 422's us.