Textures were coming in on frames other than the first.  This wasn't waking up the renderer.