Yes, you'll know that oatmeal pudding has gone bad when it starts to smell a little moldy from the milk. Another indicator is that the oats have dried out and turned a little stale.