The blessing is made on the most important fruit. The pomegranate is fruit farthest away. The least important. Yet those Jews it symbolizes are still connected to the land. The merits of a person are referred to, allegorically, as the garment one will wear in the World to Come.
More sins mean a stained garb.
More mitsvos mean a crisp clean look. The Kohen Gadol s robe symbolized the merits of all of Israel and on it s edges dangled the fringe elements of Israel. Reb Shloimke of Zvhil used to say how Lag B Omer reminded him of the Shalosh Regalim - Three Pilgrimages. All the tents of the travelers reminded him of Sukkos. The animals they brought to slaughter for food reminded him of Pesach.