There isn’t a tax credit for starting a new business. However, the IRS offers two potential tax deductions of up to $5,000 each in the first year of your operations, which can be subtracted from your taxable income for that year.