We had a very good experience at the Captains House. My group arrived at various times and each of us were met by a lovely man who assisted with our luggage and directed us to the house.
Panos had provided some great local suggestions. The house was very comfortable and very clean. Each morning a lovely lady brought in breakfast and later came back and cleaned the house.
The house is truly central to everything in Oia. I could see where noise might be an issue but for us in October it was lovely and peaceful. A secluded garden area to sit in or a small terrace were ideal spots to rest in between activities. The bus and cabs are right near. We found the buses very easy to use. I would recommend the Captains house.