WIP: Add source address to PoolManager

This is #376 after a rebase. Shortly I'll address the review comments there and get this into a merge ready state.
Optional suggestion: Might be fun to put this inside of PythonVersionWarning.