Give users the final warning before removing them...

Think this is almost done, just sharing a little early for @lindseydew