Make sure the tmp dir in the dummy app is present.

Tests in a fresh clone fail without it.