Fix issue with leaking connections when downloading remote neurons

This is not a particularly satisfactory solution, but it does seem to work.