Remove listeners and references in actors
Add HashMap of BoardObjects and BoardObjectActors