Keep an ignore list for every server