Fixes #4262: Add local addresses to authorized connections