Chances are, you are merely adding too much of the dairy to your custard mix. Back off on the dairy and ensure that it is thoroughly mixed with the egg. Also, make sure your bread is -at least – ¾" thick.