If your curtain rod is sagging in the center even though you have heavy curtains, there are two ways to fix it:
Add a center bracket. Install a third bracket underneath the center of the rod to provide more support.
Get a stronger curtain rod that can better handle the weight of your curtains.