Depending on what you want to do while in Symi, you will need at least one day. If you want to explore the town and its surroundings, swim in the clear waters, and take a bus to the Panormitis Monastery, two or three days would be better.