White hats turn yellow because of sweat stains. When you wear your hat in hot weather, the brim soaks up perspiration, turning it yellow.