Budapest is affordable for the budget backpacker. A hostel dorm room costs from 7€ up to 15€ - nice!
Public transport, such as trams, is frequent and affordable. Obviously is you stay central you can save even more money.