TheBloke

/

StableBeluga2-70B-GGML

like 39

Does it happen to anyone? I use stablebeluga2.ggmlv3.q4_K_M.bin to generate data from almost similar prompt like:
"""

System: This is a system prompt, please behave and help the user.

User:

                   {paragaph}
                   Questions: {Question}
                   Use information in the given paragraph to answer the Question

Assistant:

"""
GPU: 2x3090
n_gpu_layers : 60