Handle empty configurations

See comment on features/runner.feature