Hats do not contribute to hair loss. There is no evidence that suggests wearing a hat will cause hair loss. Many people wear hats simply to hide their hair loss. However, a dirty hat can cause a scalp infection, which may accelerate hair loss, so be sure to keep your hats and head clean.