fix(peer): set lastActivity even if no response is received

fixes #222