Clean up after install

- Makes the installed gem about 4% smaller.
- The shared object is installed to lib.