Additional checks to avoid ranks on destroyed actors

#4075