Figure out selected swatch even with no focus