Make sure users aren't on their own buddy/ignore lists