It could be that the yeast died (milk too warm), or you added the butter too soon.