|
--- |
|
license: llama3 |
|
tags: |
|
- not-for-all-audiences |
|
--- |
|
I have no idea what I’m doing… if this causes the apocalypse someone please let me know. |
|
|
|
L3-Arcania-4x8b 6.0bpw h8 EXL2 |
|
|
|
Includes [measurement.json](https://huggingface.co/FuturisticVibes/L3-Arcania-4x8b-6.0bpw-h8-exl2/tree/measurement) file for further quantization |
|
|
|
Original Model: https://huggingface.co/Steelskull/L3-Arcania-4x8b |
|
|
|
# Original Model Card |
|
|
|
<!DOCTYPE html> |
|
<style> |
|
|
|
body { |
|
|
|
font-family: 'Quicksand', sans-serif; |
|
|
|
background: linear-gradient(135deg, #2E3440 0%, #1A202C 100%); |
|
|
|
color: #D8DEE9; |
|
|
|
margin: 0; |
|
|
|
padding: 0; |
|
|
|
font-size: 16px; |
|
|
|
} |
|
|
|
.container { |
|
|
|
width: 80% auto; |
|
|
|
max-width: 1080px auto; |
|
|
|
margin: 20px auto; |
|
|
|
background-color: rgba(255, 255, 255, 0.02); |
|
|
|
padding: 20px; |
|
|
|
border-radius: 12px; |
|
|
|
box-shadow: 0 4px 10px rgba(0, 0, 0, 0.2); |
|
|
|
backdrop-filter: blur(10px); |
|
|
|
border: 1px solid rgba(255, 255, 255, 0.1); |
|
|
|
} |
|
|
|
.header h1 { |
|
|
|
font-size: 28px; |
|
|
|
color: #ECEFF4; |
|
|
|
margin: 0 0 20px 0; |
|
|
|
text-shadow: 2px 2px 4px rgba(0, 0, 0, 0.3); |
|
|
|
} |
|
|
|
.update-section { |
|
|
|
margin-top: 30px; |
|
|
|
} |
|
|
|
.update-section h2 { |
|
|
|
font-size: 24px; |
|
|
|
color: #88C0D0; |
|
|
|
} |
|
|
|
.update-section p { |
|
|
|
font-size: 16px; |
|
|
|
line-height: 1.6; |
|
|
|
color: #ECEFF4; |
|
|
|
} |
|
|
|
.info img { |
|
|
|
width: 100%; |
|
|
|
border-radius: 10px; |
|
|
|
margin-bottom: 15px; |
|
|
|
} |
|
|
|
a { |
|
|
|
color: #88C0D0; |
|
|
|
text-decoration: none; |
|
|
|
} |
|
|
|
a:hover { |
|
|
|
color: #A3BE8C; |
|
|
|
} |
|
|
|
.button { |
|
|
|
display: inline-block; |
|
|
|
background-color: #5E81AC; |
|
|
|
color: #E5E9F0; |
|
|
|
padding: 10px 20px; |
|
|
|
border-radius: 5px; |
|
|
|
cursor: pointer; |
|
|
|
text-decoration: none; |
|
|
|
} |
|
|
|
.button:hover { |
|
|
|
background-color: #81A1C1; |
|
|
|
} |
|
|
|
pre { |
|
|
|
background-color: #2E3440; |
|
|
|
padding: 10px; |
|
|
|
border-radius: 5px; |
|
|
|
overflow-x: auto; |
|
|
|
} |
|
|
|
code { |
|
|
|
font-family: 'Courier New', monospace; |
|
|
|
color: #D8DEE9; |
|
|
|
} |
|
|
|
</style> |
|
<html lang="en"> |
|
<head> |
|
<meta charset="UTF-8"> |
|
<meta name="viewport" content="width=device-width, initial-scale=1.0"> |
|
<title>L3-Arcania-4x8b Data Card</title> |
|
<link href="https://fonts.googleapis.com/css2?family=Quicksand:wght@400;500;600&display=swap" rel="stylesheet"> |
|
</head> |
|
<body> |
|
<div class="container"> |
|
<div class="header"> |
|
<h1>L3-Arcania-4x8b</h1> |
|
</div> |
|
<div class="info"> |
|
<img src="https://cdn-uploads.huggingface.co/production/uploads/64545af5ec40bbbd01242ca6/HfdZs1XAXZ8vfd8ZFLq8H.png"> |
|
<p>Now that the cute anime girl has your attention.</p> |
|
<p><strong>Creator:</strong> <a href="https://huggingface.co/Steelskull" target="_blank">SteelSkull</a></p> |
|
<p><strong>About L3-Arcania-4x8b:</strong> A Mixture of Experts model designed for general assistance, storytelling, roleplay, and ERP.</p> |
|
<li>Integrates models from notable sources for enhanced performance in diverse tasks.</p> |
|
<p>This model is based off of the work ive done on Umbra v1-v3 basically the gates are trained off of Keywords that direct the gates but not limit as much as a full prompt would. My goal is Quality not quantity</p> |
|
<p><strong>Source Models:</strong></p> |
|
<ul> |
|
<li><a href="https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct">meta-llama/Meta-Llama-3-8B-Instruct</a></li> |
|
<li><a href="https://huggingface.co/Sao10K/L3-Solana-8B-v1">Sao10K/L3-Solana-8B-v1</a></li> |
|
<li><a href="https://huggingface.co/dreamgen-preview/opus-v1.2-llama-3-8b-instruct-run3.5-epoch2.5">dreamgen-preview/opus-v1.2-llama-3-8b-instruct-run3.5-epoch2.5</a></li> |
|
<li><a href="https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1">NeverSleep/Llama-3-Lumimaid-8B-v0.1</a></li> |
|
<li><a href="https://huggingface.co/cgato/L3-TheSpice-8b-v0.1.3">cgato/L3-TheSpice-8b-v0.1.3</a></li> |
|
</ul> |
|
</div> |
|
<div class="update-section"> |
|
<h2>Quants:</h2> |
|
<p> Recommended: (Thanks to <a href="https://huggingface.co/mradermacher">@Mradermacher!</a>, please send them likes!)</p> |
|
<p><a href="https://huggingface.co/mradermacher/L3-Arcania-4x8b-GGUF">L3-Arcania-4x8b-GGUF (all GGUFs)</a></p> |
|
<p><a href="https://huggingface.co/mradermacher/L3-Arcania-4x8b-i1-GGUF">L3-Arcania-4x8b-i1-GGUF (i Quant GGUFs)</a></p> |
|
<p> My Quants: (they work, just not many choices) </p> |
|
<p><a href="https://huggingface.co/SteelQuants/L3-Arcania-4x8b-Q4_K_M-GGUF">SteelQuants/L3-Arcania-4x8b-Q4_K_M-GGUF</a></p> |
|
<p><a href="https://huggingface.co/SteelQuants/L3-Arcania-4x8b-Q5_K_M-GGUF">SteelQuants/L3-Arcania-4x8b-Q5_K_M-GGUF</a></p> |
|
<h3>Config:</h3> |
|
<p>Recommended Prompt Format: [Llama 3] </p> |
|
<pre><code><|begin_of_text|><|start_header_id|>system<|end_header_id|> |
|
{{prompt}}<|eot_id|>{{history}}<|start_header_id|>{{char}}<|end_header_id|> |
|
</code></pre> |
|
<p> Model Config: </p> |
|
<pre><code>MODEL_NAME = "L3-Arcania-4x8b" |
|
base_model: meta-llama/Meta-Llama-3-8B-Instruct |
|
gate_mode: hidden |
|
dtype: bfloat16 |
|
experts: |
|
- source_model: Sao10K/L3-Solana-8B-v1 |
|
- source_model: dreamgen-preview/opus-v1.2-llama-3-8b-instruct-run3.5-epoch2.5 |
|
- source_model: NeverSleep/Llama-3-Lumimaid-8B-v0.1 |
|
- source_model: cgato/L3-TheSpice-8b-v0.1.3 |
|
</code></pre> |
|
<p>L3-Arcania-4x8b combines the strengths of multiple models to deliver a well-rounded, capable assistant. It excels at general tasks, storytelling, roleplay, and even more mature content.</p> |
|
<p>The base model, Meta-Llama-3-8B-Instruct, provides a solid foundation. The expert models then enhance specific capabilities:</p> |
|
<ul> |
|
<li>L3-Solana-8B-v1 adds generalist knowledge and the ability to handle a wide range of topics, including NSFW content.</li> |
|
<li>opus-v1.2-llama-3-8b-instruct-run3.5-epoch2.5 strengthens storytelling, roleplay, and long-form writing abilities.</li> |
|
<li>Llama-3-Lumimaid-8B-v0.1 introduces expertise in romantic, flirtatious, and explicit interactions.</li> |
|
<li>L3-TheSpice-8b-v0.1.3 ensures the model remains focused, tailored, and high-quality.</li> |
|
</ul> |
|
<p>The positive and negative prompts guide each expert's influence, resulting in a model that is versatile yet refined, capable of both general assistance and more specialized, mature interactions.</p> |
|
</div> |
|
</div> |
|
</body> |
|
</html> |
