Add test for #18908

That the test isn't accidently run twice in parallel.