Only load the correct conversations