Set PrintLastLog to no in sshd config
Add a reminder, because I have failed to do this one too many times ;-)