SSH2: don't remove old $this->bitmap values

Fixes #408 (hopefully)