The answer is clear and simple: No, inbound linking cannot hurt your search ranking. If inbound were to hurt your rank, your competitors would continually link to your site from link farms. Such a scenario is beyond your control. For this reason, Google cannot penalize your site for any inbound linking.