If you're looking to relax on the beach and soak up some sun, then 3-4 days may be enough time for you. However, if you're interested in exploring the cultural sites such as the Old Town or the Faro Cathedral then 5-6 days would allow you ample time to do so while still allowing for some beach time.