InternVL2-Llama3-76B: IndexError: list index out of range

#4
by ItsMaxNorm - opened

IndexError Traceback (most recent call last)
in <cell line: 116>()
114
115 path = 'OpenGVLab/InternVL2-Llama3-76B'
--> 116 device_map = split_model('InternVL2-Llama3-76B')
117 print(device_map)
118 # If you set load_in_8bit=True, you will need two 80GB GPUs.

in split_model(model_name)
95 num_layers_per_gpu = math.ceil(num_layers / (world_size - 0.5))
96 num_layers_per_gpu = [num_layers_per_gpu] * world_size
---> 97 num_layers_per_gpu[0] = math.ceil(num_layers_per_gpu[0] * 0.5)
98 layer_cnt = 0
99 for i, num_layer in enumerate(num_layers_per_gpu):

IndexError: list index out of range

ItsMaxNorm changed discussion status to closed

Sign up or log in to comment