only ban once for low rep

also only check on downvotes