There are lots of bars, headshops, brewpubs, really neat architecture, a lot of historical buildings, poolhalls, neat clothing stores and galleries. There are plenty of places to eat or buy Stevie related memorabilia. Ray Hennig's Heart of TX Music - Lamar Blvd. One of Stevie's old houses - Bluebonnet, just East of Lamar. It's robin's-egg blue, hard to miss.
People live there, though, so have some respect and consideration.
You can park just West of First, south of Riverside drive for the short walk, or park over by Lamar and take the walk back to the Green Mesquite afterward. The Cold Shot video was filmed here. There was a great billboard of Stevie up when we were there, right over the restaurant. It's a pool hall now, but I believe I read in CITC that Stevie spent his first nights in Austin sleeping on a pool table right here. The competition was good and still friendly.