Keep the servers in the list, as long as they reply to queries, even if their heartbeats dont reach the master server anymore