Only add a new user file if the nick is currently on the channel (or has been since the bot was running)