yujiepan/llama-2-tiny-random

This model is randomly initialized, using the config from meta-llama/Llama-2-7b-chat-hf but with the following modifications:

{
  "hidden_size": 8,
  "intermediate_size": 32,
  "num_attention_heads": 2,
  "num_hidden_layers": 1,
  "num_key_value_heads": 2,
}