Don't count him as an enemy, but admonish him as a brother.
The discipline enforced against any brother who refuses to work is to bring about a spiritual change. He should not be counted as an enemy but be considered as a brother, an errant brother. One who is withdrawn from regardless of the reason is still our brother or sister; however, he is in error and needs to bring forth fruit meet for repentance.