Llama 3 Fantasy Writer 8B

This is llama 3 8b instruct trained on book data, r64, 8k context, 5e-5 lr, 3 epochs.

TLDR

Keep your temperatures down. 0.5 to 0.7 seem good. I usually use a little min-p and smoothing as well.

<|start_header_id|>system<|end_header_id|>

As the writer assistant, continue the story.
// Title <your story title>
// Author <an author>
// Tags <three to five categories, comma delimited>
<|eot_id|><|start_header_id|>user<|end_header_id|>
// Chapter 1
<|eot_id|><|start_header_id|>assstant<|end_header_id|>

System Prompts

I used one of these prompts as the system prompt for each sample.

system_format = """{0}
// Title {1}
// Author {2}
// Tags {3}
"""

system_prompts = [
    "Continue the story as the author's writing assistant.",
    "Take on the role of the writer's aide and proceed with the narrative.",
    "Help the author by continuing the tale.",
    "As the writer's helper, keep the story going.",
    "Collaborate with the author and advance the plot.",
    "Assist the writer by carrying on with the story.",
    "Extend the narrative as the author's co-writer.",
    "Move the story forward as the writer's assistant.",
    "Scribe for the author and continue the tale.",
    "Support the writer by proceeding with the storyline.",
    "Help keep the tale going for the author.",
    "Collaborate on the narrative and advance it.",
    "Partner with the author and carry on with the tale.",
    "Extend the plot as the writer's co-author.",
    "Move the narrative forward in collaboration with the writer.",
    "Co-write with the author and continue the story.",
    "Aid the author by keeping the plot going.",
    "Advance the story as the writer's narrative assistant.",
    "Assist in storytelling and proceed with the tale.",
    "Help continue the narrative for the writer.",
    "Carry on with the plot as the author's writing partner.",
    "Move the story forward in your role as narrative aide.",
    "Assist with the plot and keep the story going.",
    "Advance the plot as the writer's tale assistant.",
    "Extend the story in collaboration with the author.",
    "Continue the tale as the plot helper for the writer.",
    "Keep the narrative going for the author.",
    "Proceed with the plot in your role as storytelling partner.",
    "Carry on with the narrative as the plot partner.",
    "Advance the storyline as the writer's tale partner.",
    "As the author's assistant, please continue the story.",
    "Taking the role of the writer's aide, proceed with the narrative.",
    "In your role as the author's collaborator, continue the tale.",
    "Helping the writer, keep the story going.",
    "As the author's co-writer, advance the plot.",
    "Partnering with the writer, carry on with the story.",
    "In your capacity as the author's assistant, extend the narrative.",
    "Assisting the writer, move the story forward.",
    "Serving as the author's scribe, continue the tale.",
    "Supporting the writer, proceed with the storyline.",
    "Helping the author, keep the tale going.",
    "Collaborating with the writer, advance the narrative.",
    "Partnering with the author, carry on with the tale.",
    "As the writer's co-author, extend the plot.",
    "In partnership with the author, move the story forward.",
    "Co-writing with the writer, continue the narrative.",
    "Aiding the author, keep the plot going.",
    "As the writer's narrative assistant, advance the story.",
    "Assisting in storytelling, proceed with the tale.",
    "Helping to continue the narrative for the writer.",
    "Partnering with the author, carry on with the plot.",
    "Moving the story forward as the narrative aide.",
    "Helping with the plot, keep the story going.",
    "As the writer's tale assistant, advance the plot.",
    "Extending the story in collaboration with the author.",
    "Continuing the tale as the writer's plot helper.",
    "Keeping the narrative going for the author.",
    "Proceeding with the plot as the storytelling partner.",
    "Carrying on with the narrative as the plot partner.",
    "Advancing the storyline as the writer's tale partner."
]

authors = [
 'Ian Gregoire', 'Will Wight', 'Anatoly Karpov', 'Eustace Mullins', 'Orson Scott Card',
 'Neal Stephenson', 'Ray Dalio', 'Tom Neale', 'Melanie Mitchell', 'Stephen Renneberg',
 'Jeff Somers', 'Erin Bedford', 'Andrzej Sapkowski', 'Naomi Kritzer', 'Iain Banks', 'Rudy Rucker',
 'John Varley', 'Leonard Mlodinow', 'Douglas Adams', 'Michael Crichton', 'Robert Jordan', 'Andy Weir',
 'Ray Bradbury', 'Peter F. Hamilton', 'Ernest Cline', 'Michael A. Hoffman II', 'Lee Smolin',
 'Jack L. Chalker', 'Marion Zimmer Bradley, Diana L. Paxson', 'Geoffrey West', 'Arthur C. Clarke',
 'Dan Simmons', 'Karl Marx, Friedrich Engels', 'Regine Abel', 'Claudia Gray', 'D. Rus',
 'Michelle Diener', 'Adam Grant', 'Joe Hill', 'Melissa Scott', 'Alfred Bester', 'Adrian Tchaikovsky',
 'Jared Diamond', 'John C. Wright', 'Michael J. Sullivan', 'Daniel Yergin', 'Robert Anton Wilson',
 'Jack Campbell', 'Neil Gaiman, Terry Pratchett', 'Dale Carnegie', 'Tom Dowd', 'M. Mitchell Waldrop',
 'Michael R. Hicks', 'Jim Keen', 'Lewis Carroll', 'Elisabeth Naughton', 'Edie Meidav', 'Kim Antieau',
 'Becky Chambers', 'Malcolm Gladwell', 'David Morrell', 'Django Wexler', 'Daniel Suarez',
 'Jeff Hawkins', 'Joseph Campbell', 'Mark Anthony', 'George R. R. Martin', 'Nigel Findley', 'Laura Antoniou',
 'Robert A. Heinlein', 'JP Delaney', 'A. M. Henry', 'D. A. Boulter', 'Beth Revis', 'Joe Haldeman',
 'Jim Butcher', 'Aldous Huxley', 'Walter M. Miller Jr.', 'R. Lee Smith', 'Thucydides', 'Glynn Stewart',
 'Jackie Kingon', 'Terry Goodkind', 'Dennis E. Taylor', 'Bruce Sterling', 'Daniel Kahneman', 'M. K. Eidem',
 'Noam Chomsky, Edward S. Herman', 'David Graeber', 'James Fahy', 'Pierce Brown', 'Ursula K. Le Guin',
 'John Scalzi', 'Walter Jon Williams', 'Kristin Cashore', 'Brandon Sanderson', 'John Steakley',
 'Robert B. Cialdini', 'Charles Stross', 'Thomas Piketty', 'Geoffrey A. Landis', 'Suzanne Collins',
 'Kevin Mitnick', 'David Weber', 'Matthew Woodring Stover', 'Frank Herbert', 'Francis Knight',
 'David Hatcher Childress', 'James C. Scott', 'George Alec Effinger', 'Robert F. Jones', 'Scott Lynch',
 'Patrick Rothfuss', 'Stanislaw Lem', 'A.M. Lightner', 'Vasily Mahanenko', 'Ernest Nagel, James R. Newman',
 'Tricia Sullivan', 'Nassim Nicholas Taleb', 'Martha Wells', 'Daniel Keyes', 'James S. A. Corey',
 'Max Harms', 'Victoria Aveline', 'Nick Harkaway', 'Robert Shea, Robert Anton Wilson', 'Isaac Asimov',
 'Tad Williams', 'A. J. Marshall', 'Scott Thomas', 'Gentry Lee', 'Laurann Dohner', 'Jules Bass',
 'Douglas Hofstadter', 'Chris Voss', 'Clifford A. Pickover', 'Brian Christian, Tom Griffiths',
 'Cynthia Eden', 'Roger Penrose', 'J.R.R. Tolkien', 'Michael Taylor', 'Dan Needles', 'Steven D. Levitt, Stephen J. Dubner',
 'Robert Jordan, Brandon Sanderson', 'Margaret Weis, Tracy Hickman', 'M. D. Cooper', 'Richard K. Morgan',
 'Richard P. Feynman', 'Iain M. Banks', 'Vernor Vinge', 'Alastair Reynolds', 'Yolanda Sfetsos', 'Philip K. Dick',
 'Herodotus', 'S. E. Smith', 'Scott Phillips', 'John Gwynne', 'Kevin D. Mitnick', 'William Hertling',
 'Sara Hylton', 'D. L. Wood', 'Brian Greene', 'Roger Zelazny', 'Neal Shusterman', 'Ann Leckie', 'Gary Zukav',
 'William Gibson', 'Marion Zimmer Bradley', 'Richard Rhodes', 'Frank J. Fleming', 'Edwin A. Abbott', 'Manjit Kumar',
 'Michael Dow', 'Krista Lester', 'Robert N. Charrette', 'George Orwell', 'C.S. Lewis', 'Sarah J. Maas'
]

tags = [
 'paranormal romance', 'risk', 'drug addiction', 'survival', 'norse mythology', 'epic', 'computer science',
 'personal development', 'giants', 'anti-hero', 'politics', 'genetic engineering', 'plague', 'military',
 'social commentary', 'necromancy', 'globalization', 'environmental', 'grimdark', 'non-fiction',
 'ancient civilizations', 'star wars', 'gender', 'middle east', 'faerie', 'rationality', 'self-help',
 'coming-of-age', 'nanotechnology', 'martial arts', 'augmented reality', 'sports', 'cybersecurity',
 'science criticism', 'talking animals', 'dragonlance', 'knights radiant', 'quantum physics', 'romance',
 'science', 'underwater', 'fiction', 'hard science fiction', 'alternative history', 'cosmology', 'erotica',
 'dragons', 'communism', 'post-apocalyptic', 'psychology', 'young adult', 'complexity theory', 'chess',
 'engineering', 'evolution', 'fringe theories', 'assassins', 'alien invasion', 'psychological thriller',
 'LGBTQ+', 'wizards', 'bromance', 'theater', 'shapeshifters', 'betrayal', 'neuroscience', 'druids',
 'artificial intelligence', 'occult', 'parallel universes', 'reality questioning', 'progression fantasy',
 'physics', 'autobiography', 'social engineering', 'heist', 'surrealism', 'portal fantasy', 'media studies',
 'dark themes', 'reality manipulation', 'sea voyage', 'colonization', 'amnesia', 'folk tales', 'humor',
 'steampunk', 'magic', 'negotiation', 'sacred arts', 'conspiracy theories', 'philosophical', 'war',
 'technothriller', 'fantasy', 'healing', 'military science fiction', 'aliens', 'philosophy', 'cultivation',
 'friendship', 'political intrigue', 'paranormal', 'economics', 'dystopian', 'probability', 'coming of age',
 'conspiracy', 'adventure', 'religion', 'empire', 'psychic powers', 'vengeance', 'planetary romance',
 'mythology', 'income inequality', 'classic', 'elves', 'political fiction', 'climate change', 'action',
 'telepathy', 'pirates', 'spiritual', 'conclusion', 'historical fiction', 'banking', 'political science',
 'science fiction', 'decision making', 'virtual reality', 'short story', 'metaphysical', 'geoengineering',
 'game theory', 'chronicle of narnia', 'crime', 'space opera', 'objectivism', 'time travel', 'avalon',
 'supernatural', 'revolution', 'flintlock fantasy', 'LitRPG', 'clones', 'first contact', 'mercenaries',
 'character study', 'multiverse theory', 'space exploration', 'slice of life', 'arthurian', 'demons',
 'anthologies', 'body swapping', 'dark comedy', 'geopolitics', 'fairies', 'last battle', 'far future',
 'short stories', 'political satire', 'logic', 'behavioral economics', 'parallel worlds', 'vampires', 'rogues',
 'chosen one', 'political revolution', 'galactic empire', 'machines', 'twins', 'imperialism', 'prophecy',
 'history', 'suspense', 'absurdist', 'end times', 'anthology', 'interplanetary war', 'sacred valley',
 'motivational', 'robotics', 'epic fantasy', 'cyberpunk', 'dreams', 'satire', 'chase', 'horn', 'mathematics',
 'historical fantasy', 'horror', 'military history', 'memoirs', 'counterculture', 'siege', 'lunar colony',
 'witcher', 'epidemiology', 'political theory', 'anthropology', 'business', 'novella', 'alien contact',
 'tournament', 'western', 'fashion', 'spirituality', 'novel', 'urban fantasy', 'apocalypse', 'sociology',
 'quest', 'dark fantasy', 'political thriller', 'near future', 'cryptography', 'computer security',
 'detective', 'rescue mission', 'singularity', 'transhumanism', 'persuasion', 'robots', 'mystery'
]

User Turns

User turns are currently broken down into three groups: Chapter, Continue, Story

chapter_format = "// Chapter {0}"
continue_format = "// Continue"
the model was trained by taking 25% of the turns, and putting the first sentence in the user block. Any uncommented line should be considered story.