Group sort by buttons, and show them as being used if used