John Anthony said that wearing hats that are very tight or hot could possibly decrease blood flow to the hair follicles. That's because the decrease in blood flow could stress the hair follicles and cause them to fall out. Such hair loss is usually temporary but could become permanent over time.