Yes, excessive sugar intake of all sugars – even "natural sugar'" lowers testosterone. Testosterone levels dramatically decrease almost immediately after sugar consumption due to the rapid release of insulin in the body.