Certain places on the exterior of the home should not be caulked, since they'll cut off openings needed for air circulation or drainage. Elegant Painting says these spaces include the gap created when trim boards sit atop the siding, any wood to metal joints, weep holes on windows, and garage door panels.