You can keep the content you purchased while in the group. Leaving only restricts access to the shared content library and storage.