But with the wealth of writing talent that has graced the city, books by Burns, Scott, and Stevenson (along with poetry by Ramsey) make very suitable souvenirs of your trip.
Given the city's literary history, you might like to buy some a souvenir book written by one of its famous residents.