Whisper: Schedule refresh of roster

Fixes #129