|
--- |
|
license: cc-by-nc-4.0 |
|
--- |
|
|
|
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65b19c1b098c85365af5a83e/OAcen8tfal-7kQPRlhBeF.png) |
|
|
|
[GGUF Quants](https://huggingface.co/mradermacher/llama-3-fantasy-writer-8b-GGUF) |
|
|
|
[iMat Quants](https://huggingface.co/mradermacher/llama-3-fantasy-writer-8b-i1-GGUF) |
|
|
|
# Llama 3 Fantasy Writer 8B |
|
|
|
This is llama 3 8b instruct trained on book data, r64, 8k context, 5e-5 lr, 3 epochs. |
|
|
|
## TLDR |
|
|
|
Keep your temperatures down. 0.5 to 0.7 seem good. I usually use a little min-p and smoothing as well. |
|
|
|
``` |
|
<|start_header_id|>system<|end_header_id|> |
|
|
|
As the writer assistant, continue the story. |
|
// Title <your story title> |
|
// Author <an author> |
|
// Tags <three to five categories, comma delimited> |
|
<|eot_id|><|start_header_id|>user<|end_header_id|> |
|
// Chapter 1 |
|
<|eot_id|><|start_header_id|>assstant<|end_header_id|> |
|
``` |
|
|
|
## System Prompts |
|
|
|
I used one of these prompts as the system prompt for each sample. |
|
|
|
```python |
|
system_format = """{0} |
|
// Title {1} |
|
// Author {2} |
|
// Tags {3} |
|
""" |
|
``` |
|
|
|
```python |
|
system_prompts = [ |
|
"Continue the story as the author's writing assistant.", |
|
"Take on the role of the writer's aide and proceed with the narrative.", |
|
"Help the author by continuing the tale.", |
|
"As the writer's helper, keep the story going.", |
|
"Collaborate with the author and advance the plot.", |
|
"Assist the writer by carrying on with the story.", |
|
"Extend the narrative as the author's co-writer.", |
|
"Move the story forward as the writer's assistant.", |
|
"Scribe for the author and continue the tale.", |
|
"Support the writer by proceeding with the storyline.", |
|
"Help keep the tale going for the author.", |
|
"Collaborate on the narrative and advance it.", |
|
"Partner with the author and carry on with the tale.", |
|
"Extend the plot as the writer's co-author.", |
|
"Move the narrative forward in collaboration with the writer.", |
|
"Co-write with the author and continue the story.", |
|
"Aid the author by keeping the plot going.", |
|
"Advance the story as the writer's narrative assistant.", |
|
"Assist in storytelling and proceed with the tale.", |
|
"Help continue the narrative for the writer.", |
|
"Carry on with the plot as the author's writing partner.", |
|
"Move the story forward in your role as narrative aide.", |
|
"Assist with the plot and keep the story going.", |
|
"Advance the plot as the writer's tale assistant.", |
|
"Extend the story in collaboration with the author.", |
|
"Continue the tale as the plot helper for the writer.", |
|
"Keep the narrative going for the author.", |
|
"Proceed with the plot in your role as storytelling partner.", |
|
"Carry on with the narrative as the plot partner.", |
|
"Advance the storyline as the writer's tale partner.", |
|
"As the author's assistant, please continue the story.", |
|
"Taking the role of the writer's aide, proceed with the narrative.", |
|
"In your role as the author's collaborator, continue the tale.", |
|
"Helping the writer, keep the story going.", |
|
"As the author's co-writer, advance the plot.", |
|
"Partnering with the writer, carry on with the story.", |
|
"In your capacity as the author's assistant, extend the narrative.", |
|
"Assisting the writer, move the story forward.", |
|
"Serving as the author's scribe, continue the tale.", |
|
"Supporting the writer, proceed with the storyline.", |
|
"Helping the author, keep the tale going.", |
|
"Collaborating with the writer, advance the narrative.", |
|
"Partnering with the author, carry on with the tale.", |
|
"As the writer's co-author, extend the plot.", |
|
"In partnership with the author, move the story forward.", |
|
"Co-writing with the writer, continue the narrative.", |
|
"Aiding the author, keep the plot going.", |
|
"As the writer's narrative assistant, advance the story.", |
|
"Assisting in storytelling, proceed with the tale.", |
|
"Helping to continue the narrative for the writer.", |
|
"Partnering with the author, carry on with the plot.", |
|
"Moving the story forward as the narrative aide.", |
|
"Helping with the plot, keep the story going.", |
|
"As the writer's tale assistant, advance the plot.", |
|
"Extending the story in collaboration with the author.", |
|
"Continuing the tale as the writer's plot helper.", |
|
"Keeping the narrative going for the author.", |
|
"Proceeding with the plot as the storytelling partner.", |
|
"Carrying on with the narrative as the plot partner.", |
|
"Advancing the storyline as the writer's tale partner." |
|
] |
|
``` |
|
|
|
```python |
|
authors = [ |
|
'Ian Gregoire', 'Will Wight', 'Anatoly Karpov', 'Eustace Mullins', 'Orson Scott Card', |
|
'Neal Stephenson', 'Ray Dalio', 'Tom Neale', 'Melanie Mitchell', 'Stephen Renneberg', |
|
'Jeff Somers', 'Erin Bedford', 'Andrzej Sapkowski', 'Naomi Kritzer', 'Iain Banks', 'Rudy Rucker', |
|
'John Varley', 'Leonard Mlodinow', 'Douglas Adams', 'Michael Crichton', 'Robert Jordan', 'Andy Weir', |
|
'Ray Bradbury', 'Peter F. Hamilton', 'Ernest Cline', 'Michael A. Hoffman II', 'Lee Smolin', |
|
'Jack L. Chalker', 'Marion Zimmer Bradley, Diana L. Paxson', 'Geoffrey West', 'Arthur C. Clarke', |
|
'Dan Simmons', 'Karl Marx, Friedrich Engels', 'Regine Abel', 'Claudia Gray', 'D. Rus', |
|
'Michelle Diener', 'Adam Grant', 'Joe Hill', 'Melissa Scott', 'Alfred Bester', 'Adrian Tchaikovsky', |
|
'Jared Diamond', 'John C. Wright', 'Michael J. Sullivan', 'Daniel Yergin', 'Robert Anton Wilson', |
|
'Jack Campbell', 'Neil Gaiman, Terry Pratchett', 'Dale Carnegie', 'Tom Dowd', 'M. Mitchell Waldrop', |
|
'Michael R. Hicks', 'Jim Keen', 'Lewis Carroll', 'Elisabeth Naughton', 'Edie Meidav', 'Kim Antieau', |
|
'Becky Chambers', 'Malcolm Gladwell', 'David Morrell', 'Django Wexler', 'Daniel Suarez', |
|
'Jeff Hawkins', 'Joseph Campbell', 'Mark Anthony', 'George R. R. Martin', 'Nigel Findley', 'Laura Antoniou', |
|
'Robert A. Heinlein', 'JP Delaney', 'A. M. Henry', 'D. A. Boulter', 'Beth Revis', 'Joe Haldeman', |
|
'Jim Butcher', 'Aldous Huxley', 'Walter M. Miller Jr.', 'R. Lee Smith', 'Thucydides', 'Glynn Stewart', |
|
'Jackie Kingon', 'Terry Goodkind', 'Dennis E. Taylor', 'Bruce Sterling', 'Daniel Kahneman', 'M. K. Eidem', |
|
'Noam Chomsky, Edward S. Herman', 'David Graeber', 'James Fahy', 'Pierce Brown', 'Ursula K. Le Guin', |
|
'John Scalzi', 'Walter Jon Williams', 'Kristin Cashore', 'Brandon Sanderson', 'John Steakley', |
|
'Robert B. Cialdini', 'Charles Stross', 'Thomas Piketty', 'Geoffrey A. Landis', 'Suzanne Collins', |
|
'Kevin Mitnick', 'David Weber', 'Matthew Woodring Stover', 'Frank Herbert', 'Francis Knight', |
|
'David Hatcher Childress', 'James C. Scott', 'George Alec Effinger', 'Robert F. Jones', 'Scott Lynch', |
|
'Patrick Rothfuss', 'Stanislaw Lem', 'A.M. Lightner', 'Vasily Mahanenko', 'Ernest Nagel, James R. Newman', |
|
'Tricia Sullivan', 'Nassim Nicholas Taleb', 'Martha Wells', 'Daniel Keyes', 'James S. A. Corey', |
|
'Max Harms', 'Victoria Aveline', 'Nick Harkaway', 'Robert Shea, Robert Anton Wilson', 'Isaac Asimov', |
|
'Tad Williams', 'A. J. Marshall', 'Scott Thomas', 'Gentry Lee', 'Laurann Dohner', 'Jules Bass', |
|
'Douglas Hofstadter', 'Chris Voss', 'Clifford A. Pickover', 'Brian Christian, Tom Griffiths', |
|
'Cynthia Eden', 'Roger Penrose', 'J.R.R. Tolkien', 'Michael Taylor', 'Dan Needles', 'Steven D. Levitt, Stephen J. Dubner', |
|
'Robert Jordan, Brandon Sanderson', 'Margaret Weis, Tracy Hickman', 'M. D. Cooper', 'Richard K. Morgan', |
|
'Richard P. Feynman', 'Iain M. Banks', 'Vernor Vinge', 'Alastair Reynolds', 'Yolanda Sfetsos', 'Philip K. Dick', |
|
'Herodotus', 'S. E. Smith', 'Scott Phillips', 'John Gwynne', 'Kevin D. Mitnick', 'William Hertling', |
|
'Sara Hylton', 'D. L. Wood', 'Brian Greene', 'Roger Zelazny', 'Neal Shusterman', 'Ann Leckie', 'Gary Zukav', |
|
'William Gibson', 'Marion Zimmer Bradley', 'Richard Rhodes', 'Frank J. Fleming', 'Edwin A. Abbott', 'Manjit Kumar', |
|
'Michael Dow', 'Krista Lester', 'Robert N. Charrette', 'George Orwell', 'C.S. Lewis', 'Sarah J. Maas' |
|
] |
|
``` |
|
|
|
```python |
|
tags = [ |
|
'paranormal romance', 'risk', 'drug addiction', 'survival', 'norse mythology', 'epic', 'computer science', |
|
'personal development', 'giants', 'anti-hero', 'politics', 'genetic engineering', 'plague', 'military', |
|
'social commentary', 'necromancy', 'globalization', 'environmental', 'grimdark', 'non-fiction', |
|
'ancient civilizations', 'star wars', 'gender', 'middle east', 'faerie', 'rationality', 'self-help', |
|
'coming-of-age', 'nanotechnology', 'martial arts', 'augmented reality', 'sports', 'cybersecurity', |
|
'science criticism', 'talking animals', 'dragonlance', 'knights radiant', 'quantum physics', 'romance', |
|
'science', 'underwater', 'fiction', 'hard science fiction', 'alternative history', 'cosmology', 'erotica', |
|
'dragons', 'communism', 'post-apocalyptic', 'psychology', 'young adult', 'complexity theory', 'chess', |
|
'engineering', 'evolution', 'fringe theories', 'assassins', 'alien invasion', 'psychological thriller', |
|
'LGBTQ+', 'wizards', 'bromance', 'theater', 'shapeshifters', 'betrayal', 'neuroscience', 'druids', |
|
'artificial intelligence', 'occult', 'parallel universes', 'reality questioning', 'progression fantasy', |
|
'physics', 'autobiography', 'social engineering', 'heist', 'surrealism', 'portal fantasy', 'media studies', |
|
'dark themes', 'reality manipulation', 'sea voyage', 'colonization', 'amnesia', 'folk tales', 'humor', |
|
'steampunk', 'magic', 'negotiation', 'sacred arts', 'conspiracy theories', 'philosophical', 'war', |
|
'technothriller', 'fantasy', 'healing', 'military science fiction', 'aliens', 'philosophy', 'cultivation', |
|
'friendship', 'political intrigue', 'paranormal', 'economics', 'dystopian', 'probability', 'coming of age', |
|
'conspiracy', 'adventure', 'religion', 'empire', 'psychic powers', 'vengeance', 'planetary romance', |
|
'mythology', 'income inequality', 'classic', 'elves', 'political fiction', 'climate change', 'action', |
|
'telepathy', 'pirates', 'spiritual', 'conclusion', 'historical fiction', 'banking', 'political science', |
|
'science fiction', 'decision making', 'virtual reality', 'short story', 'metaphysical', 'geoengineering', |
|
'game theory', 'chronicle of narnia', 'crime', 'space opera', 'objectivism', 'time travel', 'avalon', |
|
'supernatural', 'revolution', 'flintlock fantasy', 'LitRPG', 'clones', 'first contact', 'mercenaries', |
|
'character study', 'multiverse theory', 'space exploration', 'slice of life', 'arthurian', 'demons', |
|
'anthologies', 'body swapping', 'dark comedy', 'geopolitics', 'fairies', 'last battle', 'far future', |
|
'short stories', 'political satire', 'logic', 'behavioral economics', 'parallel worlds', 'vampires', 'rogues', |
|
'chosen one', 'political revolution', 'galactic empire', 'machines', 'twins', 'imperialism', 'prophecy', |
|
'history', 'suspense', 'absurdist', 'end times', 'anthology', 'interplanetary war', 'sacred valley', |
|
'motivational', 'robotics', 'epic fantasy', 'cyberpunk', 'dreams', 'satire', 'chase', 'horn', 'mathematics', |
|
'historical fantasy', 'horror', 'military history', 'memoirs', 'counterculture', 'siege', 'lunar colony', |
|
'witcher', 'epidemiology', 'political theory', 'anthropology', 'business', 'novella', 'alien contact', |
|
'tournament', 'western', 'fashion', 'spirituality', 'novel', 'urban fantasy', 'apocalypse', 'sociology', |
|
'quest', 'dark fantasy', 'political thriller', 'near future', 'cryptography', 'computer security', |
|
'detective', 'rescue mission', 'singularity', 'transhumanism', 'persuasion', 'robots', 'mystery' |
|
] |
|
``` |
|
|
|
## User Turns |
|
|
|
User turns are currently broken down into three groups: Chapter, Continue, Story |
|
|
|
* `chapter_format = "// Chapter {0}"` |
|
* `continue_format = "// Continue"` |
|
* the model was trained by taking 25% of the turns, and putting the first sentence in the user block. Any uncommented line should be considered story. |
|
|