text: 
  
  TITLE
  No way to get ONLY the generated text, not including the prompt.
  
  COMMENTS
  3
  
  REACTIONS
  +1: 0
  -1: 0
  laugh: 0
  hooray: 0
  heart: 0
  rocket: 0
  eyes: 0
  
  BODY
  ### System Info
  
  ```shell
  - `transformers` version: 4.15.0
  - Platform: Windows-10-10.0.19041-SP0
  - Python version: 3.8.5
  - PyTorch version (GPU?): 1.10.2+cu113 (True)
  - Tensorflow version (GPU?): 2.5.1 (True)
  - Flax version (CPU?/GPU?/TPU?): not installed (NA)
  - Jax version: not installed
  - JaxLib version: not installed
  - Using GPU in script?: yes
  - Using distributed or parallel set-up in script?: no
  ```
  
  
  ### Who can help?
  
  @Narsil @patrickvonplaten 
  
  ### Information
  
  - [ ] The official example scripts
  - [ ] My own modified scripts
  
  ### Tasks
  
  - [ ] An officially supported task in the `examples` folder (such as GLUE/SQuAD, ...)
  - [ ] My own task or dataset (give details below)
  
  ### Reproduction
  
  At first I thought I could just substring by the prompt's length. This doesn't work because there's a bug where it converts every instance of " ," to "," in the generated text. 
  
  For example, "Characters in this scene: King , Gertrude." becomes "Characters in this scene: King, Gertrude."
  
  In https://github.com/huggingface/transformers/blob/main/src/transformers/generation_utils.py there are tons of options but not a single one of them allows us to specify it to ONLY return the generated text, not including the prompt.
  
  I could do a workaround where I replace all the " ," with "," myself, but I'm sure this is a code smell which could lead to future problems.
  
  Example code:
  ```
   gen_tokens = model.generate(input_ids, do_sample=specifiedDoSample, temperature=specifiedTemperature, max_length=calculated_max_length, min_length=calculated_min_length, repetition_penalty=specifiedRepetitionPenalty, bad_words_ids=badWordsTokens)
  
          #gen_text = tokenizer.batch_decode(gen_tokens)[0]
  ```
  
  
  ### Expected behavior
  
  Two possibilities: Either don't modify the prompt at all so I can substring by the prompt's length, or have an option where we get only the generated text not including the prompt.