Very cheap alternative and a short distance from the city. 7 pound from waverly station
Leith walk was a great place.