Leave me alone! - Isolate end to end tests into separate tables

Allow for better parallel execution.
@AndriySvyryd This should fix the errors you saw in CI.