Workaround for error when using setRemoveWhenFarAway

I'm not entirely sure if this actually helps or just prevents the error
from being thrown.