When setting matrix of an entity explicitly, we mean to set its position for the camera visibility check too