Don't Py_DECREF context->quality_layers if there is no encoder