Caves House is a beautiful place in a wonderful location. There is plenty happening if you want to partake of it: live music, outdoor cinema and a market in the week we were there. The apartments are lovely and very clean and confortable.
The only drawback is the lack of dining options. We were told on arrival (sadly quite late on a Monday afternoon) that only pizza or chips were availble for dinner, those from the outside bar. This was also the case for the following evening. We were hoping for a romantic dinner in the Caves House dining room. There are no very close restaurants but luckily we did obtain a booking for Casina, on the road to Dunsborough, and it was wonderful.