prune attributes based on the min_users limit