Fritters can fall apart for a couple reasons. They could be too watery or not have enough flour or eggs to act as a binder. Also, if your pan is not hot enough or you don't use enough oil this could result in a problem with fritters falling apart.