Create a new comment file if it doesn't exist yet