Question: how to make peanut butter and jelly costume?
Answer: Obviously you need bread, right? ... 
Add some peanut butter (brown color paint) to one slice of bread and Jelly (purple color paint) to the other slice.
Tape a string/ribbon to the back side of the bread with the tape so you can tie the costume to the child around his belly.