File size: 2,629 Bytes
3a76a4e |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 |
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1">
<title>llama-cpp-wasm</title>
<link rel="icon" type="image/png" href="favicon.png" />
<!-- picocss -->
<link
rel="stylesheet"
href="https://cdn.jsdelivr.net/npm/@picocss/pico@2/css/pico.min.css"
/>
</head>
<body>
<header class="container">
<hgroup>
<h1><a href="/">llama-cpp-wasm</a></h1>
<br />
<p> WebAssembly (Wasm) Build and Bindings for <a href="https://github.com/ggerganov/llama.cpp" target="_blank">llama.cpp</a>. </p>
<br />
<p> This demonstration enables you to run LLM models directly in your browser utilizing JavaScript, WebAssembly, and llama.cpp. </p>
<br />
<p> Repository: <a href="https://github.com/tangledgroup/llama-cpp-wasm"> https://github.com/tangledgroup/llama-cpp-wasm </a></p>
</hgroup>
</header>
<main class="container">
<section>
<img src="img/run-llama-cpp-in-browser-twitter-fs8.png" alt="llama-cpp-wasm" />
</section>
<hr />
<section>
<h2> In-Browser Demos </h2>
<ul>
<li><a href="/example-single-thread.html"> 🐢 <b> single thread </b> wasm32 </a></li>
<li><a href="/example-multi-thread.html"> 🐇 <b> multithreading </b> wasm32 </a></li>
</ul>
</section>
<hr />
<section>
<h2> Ecosystem </h2>
<article class="component">
<div class="grid">
<div>
<a href="https://github.com/WebAssembly">
<img
src="img/wasm.png"
alt="wasm" />
</a>
</div>
<div>
<a href="https://en.wikipedia.org/wiki/JavaScript">
<img
src="img/js.png"
alt="js javascript" />
</a>
</div>
<div>
<a href="https://github.com/ggerganov/llama.cpp">
<img
src="img/llamacpp.png"
alt="llama.cpp" />
</a>
</div>
<div>
<a href="https://tangledgroup.com">
<img
src="img/tangledgroup.png"
alt="tangled tabgledgroup tangledlabs tangledhub tangledcloud tangledlab" />
</a>
</div>
</div>
</article>
</section>
</main>
</body>
</html>
|