Men are doers; they don’t analyze relationships and will busy himself with other stuff if he has become free from a commitment.
They often even brag about their freedom to their friends, saying they don’t want a relationship.
So you might have to give him time to realize his regret, but still, he might not come back because of his ego.