You can open an IRA at a bank, brokerage firm, or other financial institution. However, the former will offer more investment options and higher potential earnings.