Best Places to Grocery Shop on a BudgetAldi. If you are in one of the 35 states ALDI operates in, then you probably have seen one of their 1,600 stores.Amazon Fresh. This is a fairly new grocery service that takes place entirely online. Costco. County Market. Dollar General. Food4Less. H-E-B. Kroger. Lidl. Market Basket.