Correct deal with exclusion and extensions

Fixes #438

/cc @mikesherov
Rather than remove all of these assertions, perhaps add one or two negative assertions showing that directly checking a file ignores extensions.