My friend and I stayed 6 nights in the Garden Suite. The suite has everything you need, including a well-catered kitchen and lots of handy appliances, such as a radio and coffee maker. The surrounding gardens are beautiful and worth exploring. I raided the mulberry tree a number of times during our stay for delicious sweet berries!
The suite is attached to Jude & Michel's house, however, because they were travelling interstate during our stay I can't comment on the level of privacy you would experience if they were home. I suspect it would be fine, given how conscientious and accommodating Jude and Michel were towards us.

The suite is located about 2 km out of town, which is a very nice walk or bike ride past cafes, shops, yoga studios and delicatessens.

Byron Bay the town was amazing, especially the beaches. I would highly recommend booking at least a week at a time to truly get into the holiday groove.