Remove python-bitcoinaddress dependency p.2 (issue #2867)

Previous PR #2885 got accidentally merged, so this is a continuation.
Let's remove that code entirely instead of making it optional.