text: 
  
  TITLE
  TFEncoderDecoder
  
  COMMENTS
  1
  
  REACTIONS
  +1: 0
  -1: 0
  laugh: 0
  hooray: 0
  heart: 0
  rocket: 0
  eyes: 0
  
  BODY
  # 🚀 Feature request
  
  Tensorflow version for the `EncoderDecoder` class for sequence to sequence text generation.
  
  ## Motivation
  I am replicating [this](https://arxiv.org/pdf/1907.12461.pdf) paper which studies several combinations of encoder and decoder with pretrained checkpoints. Most of it is implemented very nicely in the current API, but is not available for tensorflow. The closest thing I found was `TFT5ForConditionalGeneration` which works nicely. Are there any plans to extend this for other pretrained models such as Bert, Roberta, GPT(2)?
  
  ## Your contribution
  Happy to work on a PR if someone can provide some pointers on where to start and best practices to include new models in the existing API.
  