Fresh fish should taste and smell that way: fresh, briny and sweet, not musty,yeasty, bitter or fishy. The texture should be resilient, firm and smooth. Older fish that has become mealy or mushy tastes bad and smells worse. ... --Even whole fish should smell briny clean, not fishy. ...