Remove useless extra libs that weren't going to be available at the
builder