When shopping for an affordable soap dispenser, consider features like easy refill and cleaning, durable materials like plastic or metal, larger capacity for cost-effectiveness, and a pump mechanism that is easy to use.