You can go to thrift stores, discount stores like Big Lots, MacFrugals, and flea markets that sell used or slightly old items. Bakery thrifts sell day-old bread or cakes at half the usual cost. You can bargain with them and there is no sales tax. Garage sales are great places to find bargains. Go to garage sales early in the morning before all the good stuff is gone.
Street vendors are different.
Avoid buying expensive items from street vendors. Be especially careful buying if you feel pressured into making a quick decision. If you need furniture you can buy or lease it. Buying previously rented furniture is an option. Read the contract before signing anything.