Allow checking for backports via milestone

Feel free to merge or close as you see fit. We're keeping track of backports via milestones, so I added this to some local changes.