FYI, for the matplotlib widget, I got around this trying to find a cell's output region by using HTML() to create a div with a random UUID id, and then my comm object looks for that id to fill with content.