There is no definitive answer to this question as it depends on a variety of factors. These include the volume at which you are listening to music, the type of headphones or speakers you are using, and how long you are exposed to the noise. However, in general, headphones can cause more damage than speakers because they emit sound directly into your ear.