"Sour cream" is off-white or yellowish in color. Perhaps the poet employed this phrase to describe the classroom walls in order to emphasize the widespread negligence. The dismal color and implied bitterness reflect the children's circumstances. Or perhaps the teacher was mean enough to use real sour cream, which would have made the task even harder.