Don't create unnecessary run configurations.
Closes #412