physics: free everything upon exit

Broken by commit... yeah, I forgot. Oops.