Most employers will call your references only if you are the final candidate or one of the final two. Occasionally the final three or four. Every now and then an employer will check all the people they interview, although to me that's inconsiderate of the reference.