There are lots of things to visit in Varanasi. But if you want to cover Varanasi by popular places then three days and two nights are enough. By this time you can visit all important temples and places in Varanasi. However,  some other places like fort and institutions in Varanasi can't be covered at that time. For that you have to extend 2 more days.