How to generate text by using c#
I exported the model to onnx, it generate a encoder.onnx and decoder.onnx
I use c# to do encoder and it generate the result of "encoder_hidden_states",
Then I merge the input_ids and change to "attension_mask" to "encoder_attention_mask" and also merge into a tensor array,
And aflter decode by decoder.onnx, it outputs many tensor results like "logits","present.0.decoder.key ","present.0.decoder.value" and so on .
but I dont know hwo to use the result to do text2textgeneation .
the sample I am using also the demo "作为电子[MASK]的平台，京东绝对是领先者。如今的刘强[MASK]已经是身价过[MASK]的老板。"
the pseudo code like below ( I am using C#)
text= "作为电子[MASK]的平台，京东绝对是领先者。如今的刘强[MASK]已经是身价过[MASK]的老板。"
encoder_model = "encoder.onnx"
decoder_model = "decoder.onnx"
tokenizer = tokenizer.from("vocab.txt")
tokens= tokenizer(text)
input = processtokensAsInput()
var after_encode= onnx_encoder_infersession.run(input)
add after_encode to decode_input "which is "encoder_hidden_states"
input["attension_mask"].name = "decoder_attension_mask"
add input["attension_mask"] to decode_input
add input["input_ids"] to decode_input
var after_decode= onnx_decoder_infersession.run( decode_input)
the after_Decode contains "logits","present.0.decoder.key ","present.0.decoder.value......"
how can I leverage above to gerante the result text ?
Please kindly advise, I am new to onnxruntime .
thanks in advance.