This depends on what you want to see and how quickly. I mean, there are crazy fast day tours that'll take you to a few major sites, but you kind miss out on the whole reason Jeju is such a nice place to visit. I'd do at least 3 days but closer to a week will let you explore as you're meant to - slowly!