We loved our one week stay at Karen's place with three persons. The town of Kalavadra in which the house is located is a lovely small Greek village where you are off grid the main tourist routes and dive into the simple but hearty live of the locals.
We recommend you to rent a car or scooter which you can park perfectly in front of the house and discover the island on your own- for which Kalavadra is a lovely place of origin.
The check-in, stay and check-out is as simple as it could get and on the two floors the houe offers lots of space. I mus say th the two bed bedroom isn't a single closable room but kind of the corridor in front of the other two ones and if you want to stay with more than 4 people you could get a lack of chairs in some places and some dinnerware.
But if you are up to 4 peopl and if you want to get in touch with the locals and sweet spots on Rhodes- go for it!!!