[WIP] Make conftest remove tests instead of skipping.

Fixes #976.

Let's see if this workaround actually works. 
What's the `getattr` thing going on here? I don't understand this logic at all.

Also, can we move the list of ifaces to be a global constant