Remove sprites which do not have game objects.