Revert "Do not create my.cnf if it exists"

This reverts commit 8de24ff88540e36672964557d15312a027561149.