text: 
  
  TITLE
  examples/rag: test coverage, tiny model
  
  COMMENTS
  5
  
  REACTIONS
  +1: 0
  -1: 0
  laugh: 0
  hooray: 0
  heart: 0
  rocket: 0
  eyes: 0
  
  BODY
  Disclaimer: I don't know this code very well, this may be much harder than it seems.
  Blocking PR: #7713 
  
  
  [`examples/rag/finetune.py`, `examples/rag/finetune.sh`, `eval_rag.py`] do not seem to be tested at all.
  It would be good to have a `test_finetune.py` like `examples/seq2seq` that tested these.
  
  cc @stas00 if interested, rag is a cool new retrieval model https://arxiv.org/pdf/2005.11401.pdf