Fix site remove bug

Clicking on the li.site element at anytime was removing sites.