Store raw pointers or ref counted pointers?