Signs of overexertion during a workout can include feeling lightheaded, dizzy, or nauseous and experiencing chest pain or shortness of breath. If you experience any of these symptoms, it's important to stop exercising immediately and seek medical attention if necessary.