The cave house is managed by Hotel Kalisperis, so you’ll get the benefits of that: you can use the pool at the hotel (5-10 minutes walk uphill on the stairs), and room cleaning (I just wish this was communicated in advance as we were not aware of this, and one day we got back home and found our home being serviced). The reception personnel was very kind, helpful, and gave us much info about the island and what to do.
The house itself has all the essentials needed. We noticed it was a bit more damp and warm than expected, but in fairness a dehumidifier and AC was available to use: it was the only place among Athens, Naxos and Milos where we had to turn the AC on to sleep comfortably (but woke up with a bit of sore throat as counter effect for the dry air unfortunately).
As mentioned, the place is reachable by feet in 5 minutes downhill from the Hotel, or by car has to be reached going around the whole village (5 minutes drive): the road is with no exit, quite narrow and 2 ways (drive carefully there), and in high season very possible to have trouble finding a parking spot.
To be aware: there is a church a few
meters away, and during the weekend the bells ringing and the mass was put on speakers, so something to consider if you want to sleep late. Also, something we found a bit annoying was that the windows over the entrance brightly shined directly over the bed, waking us up with light that cannot be blocked out as soon as the sun comes up: another thing to consider if you want to sleep late. Overall a good staying.