The simple answer is yes, passive income is subject to self-employment tax. Passive income counts as part of your taxable income as a self-employed person. If you earn passive income as a side job while you're primarily employed, you don't have to pay tax on the first £1,000 you make.