Unable to generate output
I was trying to generate text from this model using huggingface but it not executing past the code
model = AutoModelForCausalLM.from_pretrained("ZySec-AI/ZySec-7B-v1")
tokenizer = AutoTokenizer.from_pretrained("ZySec-AI/ZySec-7B-v1")
what could be the reason (I downloaded the model !!)
Hello Ravi Teja,
Have you had a chance to look into the ZySec project? If you haven't yet, I highly recommend exploring it. It's a great resource for security professionals looking to get started. You can find it at ZySec on GitHub.
If not, comment back I will share the inference code Colab notebook.
It would be great if you share the inference colab notebook
hi can you share the inference code Colab notebook? @venkycs
@tejaaa Does this model not work for you either? Because I'm planning to try QuantFactory/SecurityLLM-GGUF, which is a quantized version of this model
@tejaaa Does this model not work for you either? Because I'm planning to try QuantFactory/SecurityLLM-GGUF, which is a quantized version of this model
Nope, I tried a long ago.
Got it, thanks for letting me know!