Fix: Always refresh serverlist properly, don't let 64 player packets disrupt us