Better handle weird release names in failed check

Also, move failed stuff to its own file.