Only notify when /away

/set plugins.var.ruby.pushover-weechat.away "on" to configure it, so you don't get a stream of alerts during normal usage.