Figure out design for upsampling, layer potential operators, and lots more.