metadata

library_name: transformers
datasets:
  - ahmed000000000/cybersec
  - dzakwan/cybersec
language:
  - en
tags:
  - conversational

Model Card for Model ID

Works as a cyber assistant.

Model Details

Model Description

This is the model card of a 🤗 transformers model that has been pushed on the Hub.

Developed by: Zardian18
Model type: GPT2
Language(s) (NLP): English
Finetuned from model [optional]: OpenAi GPT2-medium

Model Sources [optional]

Repository: Github repo

Uses

Can be used to handle and solve basic cybersec queries.

Bias, Risks, and Limitations

Currently it is fine-tuned on GPT2, which is good but not comparable to state of the art LLMs and Transformers. Moreover, the dataset is small.

[More Information Needed]

How to Get Started with the Model

from transformers import pipeline

pipe = pipeline("text-generation", model="Zardian/Cyber_assist3.0")

from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Zardian/Cyber_assist3.0")
model = AutoModelForCausalLM.from_pretrained("Zardian/Cyber_assist3.0")

Training Details

Training Data

Cybersec queries and responses dataset consisting of 12k enteries.

Cybersec dataset with instructions and output consisting of 14k enteries.