Reduce collision checks on non players