You don’t have to, but primer will make the paint stick better. This keeps the job looking better for a longer period. If you choose not to prime the garage door, consider using paint with a built-in primer.