You don't need a federal employer identification number to start an LLC in Georgia, but you'll want to get one as soon as your LLC is approved. An EIN allows you to open a business bank account, obtain a business credit card, and register with the appropriate Georgia state licensing and taxing authorities. Registering an EIN with the IRS is free.