When purging the configuration, you should remove both dirs, `sites-available` and `site-enabled`.