Remove unused exceptions, extract the rest to their files

- One class per file makes discoverability earlier
- This is a tiny step that lets us address [#68482028]