Refactor packet listener, don't request room history