A little gem of a place very quietly situated close to the best of Edinburgh’s sights