Add basic error case test support

I'd work on #270, but in order to do so and know if I fixed it I needed to have the build support checking behavior in expected error cases.

Turned on timeout tests as proof of concept.