You have to pay social security tax on your side gig if you earn $400 or over in a calendar year. However, you only have to apply the 12.4% Social Security rate on net income up to $160,200.