No, you don’t have to go to your local German embassy. Any official with a notarized seal can certify your documents – it can be a notary or a local government office-