If your patties are falling apart, you can use a binding agent like breadcrumbs and/or eggs. Remember that if you're adding anything else, you might need to adjust the seasonings accordingly to make sure the patties are flavorful.