The mixture should be smooth and easy to work with. If it's very dry and crumbly, add a little more yogurt. If it's very wet, add a little more almond flour.  When you follow these guidelines, the patties should not be falling apart.