Yes, if your LLC is located in the District, you’re required to have one or the other. Please see this page: Certificate of Occupancy or Home Occupation Permit.
If your LLC is not located in the District (and the only DC address you have is your Registered Agent address; all other addresses are in another state), then you don’t need a Certificate of Occupancy or Home Occupation Permit.