Manage all external libraries via Bower

That's not going to be possible. Different versions have files in different locations. Also, we want to keep our repos as small as possible.