With so much to do, you could easily spend five days in San Francisco. At a minimum, budget three days to see a decent amount of attractions.