Esperance is worth visiting if you pass close by or are on a road trip from Albany or to/from Adelaide. It's a long drive from Perth for beaches when there are some amazing ones a lot closer. Obviously, it depends on your expectations and what you would like to get from your visit to Esperance.