Build only lib from package

Fixes #724 

Can you test against the output with `-v` to ensure that the library actually was built?