The annatto seeds are used purely for adding a red color to the broth. You can leave them out if they're not easily available.