Honestly, there isn't much difference at all. Yams are just a particular type of sweet potato. So if you make casserole with canned or fresh yams, you're still technically making a sweet potato casserole.