Don't install headers. We don't use them

It was all fun and games until Boost joined the party