You may have overcooked the mixture resulting in a dry crumbly mix.  To fix this, heat a little bit of ghee and mix melted ghee into the mixture to help it come together.