Fixes #582, suites running twice

If a .suite.dist.yml and a .dist.yml file exist, the according tests would run twice.