bloom-chatml-id / readme.md
haidlir's picture
Upload folder using huggingface_hub
0873cc3 verified
|
raw
history blame
937 Bytes

Notebook Info

Reference: \

Task: Chat or Conversational \ Input: User's prompt containing chat templated text in string format \ Output: Model's generated text in string format

Experiment:

  • Use bos and eos token to replace <|im_start|> and <|im_end|> in ChatML. (Inspired by: https://asmirnov.xyz/doppelganger) \
  • Penggunaan padding dan truncation sesuai max_length. \
  • Max length = 256, karena telah mengkonsumsi 33.7 GB.