Evidently when the right moment came to get rid of him he was too sharp for them.
He was too smart to let them get rid of him.