The egg and crumbled saltines serve as binders that will help to hold the patties together so don't leave them out. Refrigerating the mixture for at least 30 minutes after forming the cakes will also help everything bind together.