When the banana is soft enough to mash like a cool stick of butter. A ripe banana will be fragrant, have a large freckling of brown spots to black, and the stems will be very weak or shriveled. The darker the banana peel, the deeper the sweet banana flavor.