Fixes #5603: Remove placeholder file from new directories

http://www.rudder-project.org/redmine/issues/5603