Although not in the 5g or less category, you can choose Bojangles' Seasoned Fries, which have 3g of sugar.