Check for existence of my.conf.erb before trying to move it