Yes, testicular atrophy can be hereditary. However, not all cases are inherited, as other factors like environment or medical conditions can also contribute.