There is no one-size-fits-all answer to this question, as the taste of fish can vary depending on the type and quality of fish. However, many people believe that soaking fish in milk does indeed take away the fishy taste.