Yes, you should taste hints of a fishy flavor in sea moss. This fishy taste is subtle, but it will still be there. A slight fishy taste is good, as it must have come from the sea rather than a pool.