Pot de crème can become grainy if it's overcooked. If the custard gets too hot, it may lose its creamy texture. Also, if the chocolate is too hot, it can cause a grainy texture.