Fix JENKINS-20524

Changed to Multimap from just a normal Map so that triggers don't get
overwritten.