Rayleigh took Luffy here to train him in the use of Haki for two years. He placed his Straw Hat on a rock during this time. Rayleigh spent the first year and a half to teach Luffy the basics of Haki. After Luffy mastered them enough, Rayleigh left him alone for the remaining half year to finish his training.