Remove TESTDIRs that will always error

These are ones that have no linux-only tests we can run inside travis
Ensure new changes properly cancel unneeded tests