You can find the sword anywhere underground, but it's most easily found in its dedicated shrines, sometimes led to with one-block-wide holes that go deep underground from the surface.