Great place to stay!
In the actual town of Cadaques a short walk away from the beach and restaurants.
We went by car and be warned that some of the roads google map made us go through in Cadaques were not very car friendly (mainly narrow, steep and full of people), so stick to the bigger roads when possible.
Other than, once you get there everything is perfect. Our only regret was not staying longer.