YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
# granite-8b-rag-lora-merged
This model is a merged version combining a base model with a LoRA adapter.
## Model Description
A merged model combining Granite 3.0 8B with RAG LoRA adapter
## Usage
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
# Load model and tokenizer
model = AutoModelForCausalLM.from_pretrained("muthiahsriram/granite-8b-rag-lora-merged")
tokenizer = AutoTokenizer.from_pretrained("muthiahsriram/granite-8b-rag-lora-merged")
# Example usage
text = "Your input text here"
inputs = tokenizer(text, return_tensors="pt")
outputs = model.generate(**inputs)
result = tokenizer.decode(outputs[0], skip_special_tokens=True)
```
- Downloads last month
- 6
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.