Clean up the app themes directory