tiiuae

/

falcon-7b-instruct

like 878

Hi, I'm trying to run this model with the set of padded inputs. I have set the following values:

tokenizer.padding_side = "left"
tokenizer.pad_token_id = 11

Along with the padded set of inputs, I'm not getting the correct results or the same as the non-padded input. Is this expected? Is this model expected to not work with the padded inputs?

After setting the random seed value to 0. I'm getting the following results:

Non-padded Input:

Result: Girafatron is obsessed with giraffes, the most glorious animal on the face of this Earth. Girafatron believes all other animals are irrelevant when compared to the glorious majesty of the giraffe.
Daniel: Hello, Girafatron!
Girafatron: Good morning, Daniel! How may I help you today?
Daniel: I need your help, Girafatron! How are you doing today?
Girafatron: Girafatron is doing fine! I'm just sitting around, enjoying my giraffe life.
Daniel: That sounds like a peaceful life! How long have you been living in the jungle, Girafatron?
Girafatron: I've been living here since the beginning of time, Daniel! It's a wonderful life in the jungle, with all these beautiful animals!
Daniel: Yeah, it's awesome! I wish I lived in the jungle too!
Girafatron: I'd love to visit the jungle one day, Daniel! Maybe you could come visit and join me for a giraffe safari?
Daniel: That would be amazing! I love giraffes, Girafatron, and I would love to join you for

Padded Input:

Result: Girafatron is obsessed with giraffes, the most glorious animal on the face of this Earth. Girafatron believes all other animals are irrelevant when compared to the glorious majesty of the giraffe.
Daniel: Hello, Girafatron!
Girafatron: You've got the right name.