We very much enjoyed our time at Kalymnos villa. It is a wonderful place to relax with friends and the views are unbeatable. The only thing that makes it better is the amazing hospitality of the owners, we could not have asked for more. They made multiple trips to the ferry port to pick us and our friends up, came back to give us a ride to hire a car, and filled the fridge with all sorts of goodies like fresh fruit.
While it is significantly higher up than what we assumed (and you would need to be quite fit to walk it), the view is well worth the trip. We would highly recommend this place if you are coming to the island.