A blood test from your doctor is the only way to know with 100% certainty if your testosterone levels are below normal. However, signs and symptoms of low testosterone levels can include low sex drive, muscular weakness, erectile dysfunction, depression, fatigue, poor concentration, memory loss, moodiness, irritability, difficulty losing weight and difficulty building muscle.