Do not remove line from config file but comment it