Thus, we don't know how the mind acts, so this may even be plausible. Consider an electron. It's hard to pin down. Flows of electrons through chemical reactions. Yet we have, or at least have the illusion that we have, control over these.
Most displayed magic is magic of healing.
This is the mind convincing the body that it does not hurt. Shifting nerve impulses. Quantum mechanically, encouraging electrons to go to a different state. Similarly, I can't make a pencil vanish, because a pencil is very probably there. There is a near certainty that at least some of the matter in a pencil exists at any given time.