[WIP] Make conftest remove tests instead of skipping.

Fixes #976.

Let's see if this workaround actually works.