The terrace overlooking the bay is amazing and the house is infinitely charming