SYN-47: Fix bug where we still returned events for rooms we had left.

SYN-47 #resolve