Remove elegance-colors directory if it exists