README.md

---
license: mit
language:
- en
library_name: transformers
pipeline_tag: text-generation
---

# Model Card: Novus-7B-Instruct-SEO

## Version: Based on Mistral-7B-v0.2, Fine-Tuned with SFT
## Model Description

Novus-7B-Instruct-SEO is fine-tuned on Mistral-7B-v0.2 using SFT. 

Our SEO model was trained on a custom hand-curated dataset that contains keywords as inputs and SEO-related blog posts as outputs. Using foundational models, our dataset was further enhanced by augmenting the data.


## Training
Novus-7B-Instruct-SEO was trained over 3 epochs using QLoRA with a Lora Rank of 16, on a single H100 GPU.

```python
model = AutoModelForCausalLM.from_pretrained("NovusResearch/Novus-7B-Instruct-SEO",
  use_flash_attention_2=True,
  torch_dtype=torch.bfloat16,
  device_map="auto",
  trust_remote_code=True)
```

## Example Outputs
```
Generate an SEO article using the following keywords
Keywords: Surgery, Insurance, Hospital

Surgery is a medical procedure that involves the manipulation of the body's tissues. It can be used to treat a wide range of conditions, from minor injuries to life-threatening diseases. However, surgery can be an expensive undertaking, and many people rely on insurance to help cover the costs.
When it comes to insurance coverage for surgery, there are a few things to keep in mind. First, it's important to understand what your policy covers. Most insurance plans will cover major surgeries, but there may be limitations on certain procedures or conditions. For example, some policies may not cover cosmetic surgery or surgeries for conditions that are considered pre-existing.
It's also important to check with your insurance provider to see if you need a referral from your primary care physician in order to receive coverage for surgery. In some cases, you may need to see a specialist before the insurance company will approve the procedure.
When it comes to choosing a hospital for your surgery, there are a few things to consider. First, you'll want to make sure that the hospital is covered by your insurance plan. You can check with your insurance provider to see which hospitals are in their network.
Another important factor to consider when choosing a hospital for surgery is the quality of care. You'll want to make sure that the hospital has a good reputation for patient safety and outcomes. You can check online reviews and ratings to get an idea of what other patients have to say about their experiences at the hospital.
In conclusion, surgery can be a necessary and life-saving procedure, but it can also be expensive. Insurance can help cover the costs, but it's important to understand what your policy covers and to check with your provider before scheduling the procedure. When it comes to choosing a hospital for surgery, be sure to check with your insurance provider and consider the quality of care before making your decision.
```