meta-llama

/

Meta-Llama-3.1-8B-Instruct

like 2.15k

what about extended instead of llama3

https://github.com/vllm-project/vllm/pull/6553

What can we expect this to be resolved?

Getting below error even though both 'type' and 'factor' fields are present.

ValueError: rope_scaling must be a dictionary with two fields, type and factor, got {'factor': 8.0, 'low_freq_factor': 1.0, 'high_freq_factor': 4.0, 'original_max_position_embeddings': 8192, 'rope_type': 'llama3', 'type': 'llama3'}