Avoid CKAN.sln accidentally being updated

I noted this pop up a couple of times, this could avoid us being surprised by it again. (in theory at least!)