Add tests that explicitly assert table is created

This partially reverts commit 3fc1f0393ea47e1e8d8e32555a0cffed6f9f918f.