Yes, in some cases, varicocele can obstruct the blood flow to the scrotum and impact your fertility.