Heat the oil and your skillet before adding the fritters until it's hot. This will seal the outside of the fritters and prevent them from falling apart when you flip them.