Don't send notifications when refresh is called manually

Doesn't really make any sense to send them when the user calls refresh, as they were sent when the actual change happened even when autorefresh is off.

@alazier @jpsim 
I spent an embarrassingly long amount of time waffling on that name and concluded that I didn't like the idea of putting exactly what it does in the name due to that the caller shouldn't care what exactly the realm is doing in response to an external change. It's basically the same reason as why I moved the check for autorefresh to that method from the loop.