use ',' instead of '#' to separate violating test ids.