A nice race medal is a must. Shirts are also popular, but make sure your race tee stands out, because a standard cotton tee is just not going to cut it. Look at lifestyle cuts, if doing cotton, or quality performance tees athletes can wear for training.
Although not a swag item strictly-speaking, some athletes also like a good-looking bib, so think about investing in a quality race bib, if you can afford it.