Edit model card

Fusion-In-Decoder Base on Natural Questions

This trained model is based on the Fusion-In-Decoder model, and trained on the Natural Questions dataset.

Model Details

Model is based on Fusion-In-Decoder, which in turn is based on the t5-large checkpoint as the base model. For training, we utilized text retrieval for each query, which provides a collection of relevant passages for it.

We note that the passages were retrieved using a corpus based on Wikipedia.

Evaluation

See model performance on Evaluation Results tab on the right side.

Downloads last month
9
Safetensors
Model size
738M params
Tensor type
F32
·

Dataset used to train Intel/fid_t5_large_nq

Space using Intel/fid_t5_large_nq 1

Evaluation results