It wasn't the Enumerator causing the slow down, it was the map called on the Enumerator when building a Responder. Removed unnecessary FastEnumerator.