Most supplements are safe when taken as directed, but it's still possible to have "too much of a good thing." Some adverse effects can occur if you are consistently taking too high a dose of many supplements, especially if they are fat-soluble vitamins, such as vitamins A, D, E, and K. When these vitamins build up in your system, it can lead to vitamin toxicity.