Add proper configuration to failing tests

Relates #260

(cherry picked from commit 5e724b4c520dd7402fbab4dfddf25772fa274a8f)