The key to making sure fish cakes don’t fall apart is limiting the moisture. Make sure your mashed potatoes are relatively dry and leave some lumps to provide texture. It’s also important to use a proper egg ratio–this recipe calls for two eggs per 20 cakes. If the fish cake mixture feels too moist, add some panko, about 1/3 cup at a time, and mix until it holds together when you form patties.