Good question. If your brother improperly uses trust assets or assets of your mother for his own benefit then what he has done as the trustee of your mother's estate breached a fiduciary duty warranting his removal. Given your concerns, I suggest that you consult with a Wills and trust attorney about the matter.