swift: backport logging fixes for 1.0.x upgrade

This is further Swift logging cleanup task which @craigtracey implemented on during the 1.0.x upgrade. It can be backported, but might be considered a feature too and could simply be used for future releases.

/cc @dlundquist