Don't add readline to binary packages.

This can break binary packages since Python dependencies with a binary
component (readline being the only one) are named with the target
platform in their name.