Make packaging better

This excludes lots of uneccessary things when building the extension package.