Changed how GameObjects are removed from the handler and scene