Here are a few signs you should hire a professional to come take a look at the integrity of your chimney.
Moisture-damaged drywall or wallpaper near the chimney
Pieces of tile or masonry that fall into the fireplace
Any cracks or rust in, around, or on the chimney
Smoke that doesn't go where it's supposed to
Any water or other debris in the area