[FIXED JENKINS-16833] Use a CopyOnWriteArraySet for inProgress to avoid blocking UI.