While you could visit Matera as a day trip, the town is worth at least 2 days. There's so much to see and you'll want to see Matera in the evening too.