Handling removal of topics