Again, actually, if we are going by what Jesus says, divorce is the sin.  That is my point.  Jesus states that what God has joined together let no man take apart - so no divorce.  The divorce is the sin that leads to the inevitable next sin of adultery and this is how Jesus describes it.  

The church is judging and punishing anyone it withholds Holy Eucharist from because we do not know what is in the heart of the people who have divorced or re-married but are keeping them from partaking.  

Jesus did not tell us to withhold Eucharist from anyone for any reason.  He did tell us to decide for ourselves, if we are partaking while holding a grudge against another individual but he did not tell us that unless we are perfect, we cannot partake.  The reason for this is obvious.  None of us is perfect for any length of time on our own merits.   Holy Eucharist is intended for healing, not as a reward for good, or a bribe against the poorly behaved so they straighten up their act.