To save money while living on St. Croix, you can choose a rental house over a luxury apartment, shop at local markets for lower-priced essentials, and utilize public transportation instead of owning a car.