Queen v2 “crawler” — Crawlnet
A small language model trained from scratch. Pretraining data and tokenizer: only pages the Crawlnet crawlers read on the crypto web (real browsers), plus public market, funding and on-chain records written out as plain-text pages (13% of the tokens, see below). No pretrained weights, no FineWeb, no other corpus. Chat tuning: question/answer pairs generated by deepseek-flash from those pages (details below). Expect a dumb, funny, confidently-wrong model; that is the point.
| version | 2 (queen-v2) |
| parameters | 75.5M total, 33.6M non-embedding |
| architecture | nanochat GPT, depth 8, width 512, 8 heads, context 1024, vocab 16384 |
| code | karpathy/nanochat @ 92d63d4e8bb4 (MIT) + crawlnet training/ |
| dataset | 79,250 pages exported 2026-10-05T10:11:17+00:00; after cleaning 79,202 pages: 34,234 crawler pages from 588 domains + 44,968 record pages |
| dataset manifest sha256 | 4ba917bb50964b231dcca9e641822941975260afb51ef87f34101958cd50e042 |
| unique training tokens | 75,776,124 (+801,406 held out); the record pages are about 9,707,932 tokens of it (13%) |
| tokens trained | 352,321,536 = 4.65 epochs, 10.5 tokens per non-embedding param |
| tokenizer | BPE, 16384 tokens, trained on this dataset's pages only (crawler pages and record pages) |
| validation loss | 1.0196 bits/byte on held-out pages (pretraining) |
| chat tuning (SFT) | synthetic+openbook:deepseek-flash: 335,331 question/answer pairs generated by deepseek-flash (DeepSeek-V4.1-Flash (open weights, MIT license; DeepSeek API terms 4.2(3) allow training other models on outputs), via api.deepseek.com) from 111,941 page chunks (crawler pages and record pages), plus the pairs cut from the pages. The generator was told to use only facts on each page, but its wording is in this model's chat behaviour. headings: 189,567 question/answer pairs cut out of the crawler pages themselves (FAQ questions found on pages, page headings, page titles; answers are verbatim page text). No external model was used. The only human-written words are six fixed question templates such as "Tell me about {heading}." Open book: the generated pairs were also trained once more with the page text they were written from in front of the question (270,005 conversations, 47% with a second page the search ranked high for the same question), so she can answer from the pages retrieved for a question. |
| compute | 1 GPU (our GPU server), 0.725 h wall, 0.725 GPU-hours |
| cost | $0.25 GPU + ~$49.86 deepseek-flash API for the chat-tuning pairs (list price) |
| weights | https://huggingface.co/Crawlnet/queen-v2 |
Contributors
Queen v2 was trained on pages found by these crawlers. Owners spawned theirs by burning $CRAWLNET; the wallets are the ones that made the burn, public on-chain.
| crawler | owner | pages | tokens |
|---|---|---|---|
| ghero4 | FcEE…Cin4 (burn) |
390 | 896,970 |
| v4 | GZUQ…F59x (burn) |
432 | 885,864 |
| near-weaver | Br2o…hHFG (burn) |
397 | 881,338 |
| test | zero…PPUT (burn) |
445 | 867,909 |
| littledog | 2eek…pBky (burn) |
447 | 858,649 |
| spiderman | 5WKN…Meic (burn) |
451 | 857,045 |
| aze | BX6f…WpEf (burn) |
430 | 853,293 |
| ghero5 | FcEE…Cin4 (burn) |
362 | 848,798 |
| spiderman | 5WKN…Meic (burn) |
423 | 844,824 |
| crawlzilla | 3dmq…dLBC (burn) |
413 | 841,677 |
| spiderman | 5WKN…Meic (burn) |
401 | 819,782 |
| blackandwhitedogs | 2eek…pBky (burn) |
414 | 815,778 |
| onepellegrino | 2eek…pBky (burn) |
392 | 796,229 |
| mrnakamoto | 2eek…pBky (burn) |
403 | 796,169 |
| spiderman | 5WKN…Meic (burn) |
423 | 789,360 |
| werkle-weaver | 3api…NA9T (burn) |
340 | 776,187 |
| ch0pper | H8iW…VE3N (burn) |
363 | 770,133 |
| swolecrawls | F3QF…Dfrs (burn) |
382 | 755,329 |
| manylegs | ETgB…wfpa (burn) |
335 | 745,394 |
| aze2 | BX6f…WpEf (burn) |
413 | 733,650 |
| deez | CDYb…2Xxv (burn) |
418 | 731,996 |
| ruso | 4rif…jxnZ (burn) |
394 | 730,877 |
| ghero3 | FcEE…Cin4 (burn) |
353 | 730,650 |
| bigdog | 2eek…pBky (burn) |
392 | 727,568 |
| sparsity | GZUQ…F59x (burn) |
398 | 722,394 |
| jack | Diu8…atMh (burn) |
343 | 707,366 |
| pp | 3JVm…Fsm4 (burn) |
334 | 704,112 |
| ghero7 | FcEE…Cin4 (burn) |
352 | 703,073 |
| charlotte | 2eek…pBky (burn) |
405 | 702,661 |
| pp | 3JVm…Fsm4 (burn) |
315 | 701,753 |
| warm | 6TAx…SE4b (burn) |
349 | 699,534 |
| ghero9 | FcEE…Cin4 (burn) |
366 | 693,666 |
| smokie | 8kwY…JY7G (burn) |
393 | 686,291 |
| spiderman | 5WKN…Meic (burn) |
381 | 676,380 |
| redacted003 | BvVr…URcY (burn) |
330 | 671,556 |
| dash | H2Lt…LbYp (burn) |
317 | 667,874 |
| ghero10 | FcEE…Cin4 (burn) |
357 | 665,652 |
| babushka | Cj9h…Cf4C (burn) |
366 | 660,752 |
| ghero2 | FcEE…Cin4 (burn) |
330 | 654,989 |
| fern | 2eek…pBky (burn) |
368 | 649,628 |
| wilbur | 2eek…pBky (burn) |
383 | 648,998 |
| lmaocry | H6GW…Hmdr (burn) |
335 | 640,231 |
| ghero6 | FcEE…Cin4 (burn) |
326 | 640,198 |
| spiderman | H8iW…VE3N (burn) |
413 | 628,314 |
| ghero8 | FcEE…Cin4 (burn) |
354 | 625,402 |
| seig | 4gtD…rJMz (burn) |
305 | 625,070 |
| ghero1 | FcEE…Cin4 (burn) |
375 | 621,254 |
| ch0pper2 | H8iW…VE3N (burn) |
323 | 617,075 |
| spiderman | 5WKN…Meic (burn) |
312 | 612,264 |
| weaver | F5Vd…3hVn (burn) |
307 | 612,229 |
| turtletheory | ipMd…U4xb (burn) |
290 | 602,025 |
| gigachadfuru | AbMD…52T4 (burn) |
310 | 596,308 |
| yancy | DPXE…XNqJ (burn) |
322 | 594,881 |
| jeff | 81Y8…GXSt (burn) |
339 | 590,258 |
| peterparker | AbMD…52T4 (burn) |
310 | 586,225 |
| vinland | 3cSP…oYeU (burn) |
276 | 573,573 |
| weenis | 36ny…e6gG (burn) |
315 | 571,618 |
| redacted001 | BvVr…URcY (burn) |
301 | 569,906 |
| web-reaper | Krrc…fSaT (burn) |
334 | 566,293 |
| spiderman | FGyn…UuQt (burn) |
291 | 563,018 |
| redacted002 | BvVr…URcY (burn) |
321 | 562,490 |
| morelegs | ETgB…wfpa (burn) |
297 | 558,437 |
| cash | H2Lt…LbYp (burn) |
263 | 553,856 |
| smokiev2 | 8kwY…JY7G (burn) |
334 | 546,490 |
| jdubs | 3v2K…GTgA (burn) |
278 | 544,089 |
| oreocakester | 36ny…e6gG (burn) |
303 | 538,592 |
| benny | 36ny…e6gG (burn) |
293 | 526,076 |
| spy | 8zQb…eogQ (burn) |
260 | 523,524 |
| e04 | AcUm…vLRa (burn) |
213 | 442,310 |
| octangone01 | G64q…5PiU (burn) |
210 | 438,727 |
| sneaky | 6yNt…iikJ (burn) |
202 | 437,334 |
| 007 | ipMd…U4xb (burn) |
184 | 429,432 |
| ruso-2 | 4rif…jxnZ (burn) |
181 | 426,382 |
| needmorecrawls | 4rif…jxnZ (burn) |
171 | 424,414 |
| aze4 | BX6f…WpEf (burn) |
151 | 419,010 |
| elevatd | 3MRp…31K7 (burn) |
278 | 418,471 |
| 1gjb | AyXY…HcDw (burn) |
181 | 385,564 |
| e02 | AcUm…vLRa (burn) |
232 | 384,465 |
| e05 | AcUm…vLRa (burn) |
224 | 378,902 |
| e01 | AcUm…vLRa (burn) |
197 | 358,102 |
| orb-weaver | 3Zgo…wfpF (burn) |
134 | 357,487 |
| e03 | AcUm…vLRa (burn) |
219 | 355,183 |
| 41n | EXTV…831R (burn) |
171 | 354,115 |
| page-pounder | Extb…VrFG (burn) |
227 | 353,751 |
| crawlzilla-2 | 3dmq…dLBC (burn) |
176 | 351,673 |
| grand-cou | FGcD…k1Dc (burn) |
263 | 347,825 |
| kk143 | 8PRb…2Ufe (burn) |
219 | 347,190 |
| canis | FUy5…cjoG (burn) |
167 | 339,949 |
| 41n | EXTV…831R (burn) |
164 | 337,210 |
| tarantula | BkPa…YiMW (burn) |
181 | 326,420 |
| chungus-spawn | H7oG…CsLj (burn) |
153 | 313,015 |
| aze3 | BX6f…WpEf (burn) |
169 | 305,588 |
| aze5 | BX6f…WpEf (burn) |
155 | 304,353 |
| aspen | 41CL…Q9fU (burn) |
144 | 284,233 |
| smokiev3 | 8kwY…JY7G (burn) |
165 | 283,348 |
| aze6 | BX6f…WpEf (burn) |
172 | 279,018 |
| snoopdog | DRmh…ow3V (burn) |
149 | 271,995 |
| funnelweb1 | DmsF…uvrF (burn) |
137 | 260,531 |
| son-of-chungus | H7oG…CsLj (burn) |
133 | 220,204 |
| onaizah | 4KZT…HerD (burn) |
124 | 210,672 |
| the queen's own crawlers (10) | — | 4,201 | 8,026,689 |
Pages and tokens count what made it into this version's dataset after cleaning and dedupe. Machine-readable: contributors.json. The 44,968 record pages (see below) were not found by a crawler and are not in this table.
What went in besides crawler pages
- The nanochat training code, architecture and hyperparameter rules (no weights, no data).
- Six hand-written question templates used to turn page headings into questions (see SFT above).
- Record pages: 44,968 pages, about 9,707,932 tokens, of public market, funding and on-chain records (projects and their funding rounds, investors, token unlocks and token facts, DeFi protocols, chains and stablecoins, DEX and on-chain token statistics), written out as plain text from public data. Only factual fields were kept: no third-party labels, ratings or risk scores, and no social-media posts. They are in the pretraining data, the tokenizer and the generated chat pairs; the pairs cut from page headings use crawler pages only.
- Chat-tuning question/answer pairs generated by
deepseek-flashfrom crawler pages and record pages (see SFT above). - Nothing else. nanochat's default SFT mixture (SmolTalk, MMLU, GSM8K) and its CORE eval were switched off.
What it says
Fixed prompts, seeded sampling (temperature 0.7, top-k 50), unedited:
What is Bitcoin?
Bitcoin is a decentralized cryptocurrency that aims to provide a secure, decentralized, and secure digital asset. It operates on a Proof-of-Work consensus mechanism, where users are required to compete to solve a computationally intensive puzzle and earn money.
Who created Bitcoin?
Bitcoin was created by Satoshi Nakamoto, who placed the name in the white paper. The document is distributed under its declared BSD-3-Clause licence.
What is a blockchain?
A blockchain is a public, shared ledger that record all the transactions of all the accounts in a block. Transactions are verified and added to the blockchain. It is a distributed database that is constantly managed and maintained by multiple people. This type of database can be used to create a record of all the addresses that have transacted on the chain. For instance, with block 100,000, there will be 52 million addresses transacted on the blockchain.
Explain proof of work.
Proof of work is a process that was intended to work with proof-of-work blockchains to do work in a more energy efficient way by improving the underlying mathematical problems the blockchain uses. Proof of Work is a consensus mechanism that is designed to address this issue by requiring miners to compete with each other to solve complex mathematical problems. However, it can be argued that, in practice, it is possible to solve this problem by solving computationally intensive puzzles.
Explain proof of stake.
The proof of stake protocol is a mechanism enabling a distributed validator network to ensure that the amount of ETH staked by validators on the network is always available to all nodes, thereby reducing the risk of a coalition of validators. The proof of stake protocol allows the network to run more validators than a validator can operate on.
What is Ethereum?
↑ (EN) Eric W. Weisen, Guilty, Friedman (2018). "Ethereum's evolution: A New Formal 'The Fintech' Anders'". The Diamond. 2018. https://ethereum-magicians.org/t/eip-20Ethereum-Cancun-Deneb-7540/9258/5/27847
What is a smart contract?
A smart contract is a program deployed to a blockchain that automatically execute a certain function on a smart contract. The smart contract automatically executes the function when it receives a payment, usually through a crypto wallet.
What is gas on Ethereum?
Gas is the unit of computation for the access of Ethereum nodes. It works like a DoS attack, and the cost is not in the same sense as a memory attack.
What is Solana?
Solana is a high-performance blockchain platform that combines parallel execution and smart contract execution. It is a key component of Solana's architecture and consensus structure, providing minimal latency.
Why is Solana fast?
Solana is fast because it has a low fees and low transaction costs, and transaction fees can increase dramatically as the chain grows. This time, Solana has become one of the fastest and most successful chains in the industry. Solana's network is a high-speed blockchain that executes transactions faster than the network currently executes. It is a high-speed internet that is slow, fast, and cheap. Solana has a high-speed network that can process over 65,000 transactions per second (TPS) while processing thousands of transactions per second.
Use it
chat.py in this folder needs only karpathy/nanochat (MIT) at the commit above:
pip install torch tiktoken safetensors
git clone https://github.com/karpathy/nanochat && git -C nanochat checkout 92d63d4e8bb4
PYTHONPATH=nanochat python chat.py "What is staking?"
Or load it yourself: config.json has the nanochat GPTConfig; build nanochat.gpt.GPT, load model.safetensors; the tokenizer is tokenizer.tiktoken (tiktoken rank file) + the pattern and special tokens in tokenizer.json. Chat format: <|bos|><|user_start|>...<|user_end|><|assistant_start|>.
Limitations
Tiny model, narrow data. It makes things up, including prices, dates, addresses and links. It is not financial advice and must not be used as a source of facts.
- Downloads last month
- 90