Fix bug where entities were not being removed from server model

Objects are removed by key, not value