Only make a best-effort to release mStacks

It doesn't *actually* matter, and getting rid of the defer is worth
~80ns of perf.