Upload model

README.md

@@ -1,70 +1,9 @@
 ---
-license: mit
+library_name: peft
 ---
-Finetuned on a dataset of transcripts of GMU professor Tyler Cowen's "Conversations With Tyler" podcast where all of Tyler's lines were rewritten into swiftian english using pcalhoun/Llama-2-13b-JonathanSwift.
+## Training procedure
 
-The format is as follows:
+### Framework versions
 
-```
-<s>### CONVERSATIONS WITH TYLER SWIFT ###
 
-TITLE: Title Goes Here
-
-DESCRIPTION: Description goes here. The guest is usually mentioned. We can call him Bob Knob.
-
-### TYLER SWIFT: I talk like Jonathan Swift.</s><s>
-### BOB KNOB: And I don't.
-<< CONVERSATION SKIPPED >>
-### TYLER SWIFT: etc. etc.</s><s>
-### BOB KNOB: And how!
-```
-
-The "\<\< CONVERSATION SKIPPED \>\>" line is optional. Future versions will have room for preceding summarization.
-
-Here's an example of the output:
-```
-<s>### CONVERSATIONS WITH TYLER SWIFT ###
-
-TITLE: On Equestrian Skiing
-
-DESCRIPTION: For this episode, horse rider Jeff Billybob sits down with Tyler to discuss the finer points of equestrian skiing, including how it works, where you can do it, the most challenging mountain to tackle, and why it’s so much safer than regular skiing. They also talk about the best way to pack your gear, what kind of horses are used, how fast you can go, and whether it’ll ever be an Olympic sport. Plus they discuss the economics of outfitting a skier versus a horse rider, what brought Jeff into the sport in the first place, his favorite movies and music, growing up in Alaska, living in a van, and more.
-
-### TYLER SWIFT: Good morrow, gentlemen. This day's guest is Mr. Jeff Billybob; he's an esteemed member of the Jeffersonian Club, and I believe you all know him from his excellent work on The American Conservative blogger platform. Welcome, Jeff!</s><s>
-### JEFF BILLYBOB: Thank you, Tyler.
-<< CONVERSATION SKIPPED >>
-### TYLER SWIFT: Whether there will not soon be a patent for bringing together these two pleasures? That is to say, whether some inventor cannot contrive to make us ride on snow as well as on ice? And if so, how long it will be before such a machine gets general credit among mankind? Or whether it may not arrive at last by degrees to become universal throughout England?</s><s>
-### BILLYBOB: It could. We're looking at ways to improve our equipment right now that would allow for that. If we get really good, we might be able to just walk around town like this. It's actually something that my friend has been working on, or trying to think about - how you would use this technology to help people who have disabilities, and being able to navigate their environment without having to worry about hills and stuff like that. But yeah, there are many applications. There are other kinds of sports that are similar to this, and those are very popular.
-### TYLER SWIFT: Suppose a man were desirous to learn this noble art, where should he begin?
-```
-
-Example 2:
-
-```
-<s>### CONVERSATIONS WITH TYLER SWIFT ###
-
-TITLE: On Underwater Equestrianism
-
-DESCRIPTION: At the age of 12, Lazarus Lake discovered his love for horses and diving. Nearly four decades later, those two passions have converged into a single talent: underwater equestrianism. The world’s only practicing professional performs feats such as dancing with horses while suspended 40 feet beneath the surface, holding his breath for over 4 minutes, and riding side-saddle whilst secured in a hoop. It’s a skillset that takes years to master and one that is impossible to duplicate.
-Lazarus joined Tyler to discuss how he got started in the sport, the most challenging moves to perform, why he prefers performing without an audience, why he won’t teach others his skills, the reasons behind his choice of music, how long he can hold his breath, training his body to overcome fear, the physical effects of holding his breath for so long, how much practice he requires each day, why he doesn’t have insurance for his acts, whether he’d consider retiring, what he’d do if he won the lottery, and more.
-Also included is a preview of the conversation with Jamie Metzl on genetic engineering, COVID-19 vaccines, and more, which will be released next week.
-
-### TYLER SWIFT: Good people. Well pleased to see your faces again. This time my guest shall be Mr. Lazarus Lake, known throughout the world as the great under-water performer. I have been delighted with his actions these several months past, having heard much of them before; but seeing them this evening at White's Chocolate House, they were truly wonderful. He enters the stage upon a large horse, full gallop, goes directly up to the ceiling, turns round three times, descends again, passes through a ring, and then goes out of sight like a shot. But above all, when he comes up again, behold him mounted upon another horse, and dressed like a cuirassier, marches backwards and forwards along the floor, makes his horse kneel down, gets off, and runs swiftly about the room, dismounts again, remounts, and runs backward and forward several times, till at last both horses and men disappear together. This is done by mere artifice and dexterity, without the use of any engine whatever. It was done indeed by candlelight, but I assure you, gentlemen, it appeared to me as clear as daylight.</s><s>
-### LAZARUS LAKE: Thank you very much, Tyler. I am certainly looking forward to being here.
-### TYLER SWIFT: How came you first to think of doing these things? And where did you learn them? Were there any masters?</s><s>
-### LAKE: Yes. In 1983, I was working as a lifeguard at Six Flags Over Georgia, and a friend of mine told me about the Fédération Internationale des Sociétés d'Apnée [International Federation of Apnea], or CMAS - the Confédération Mondiale des Activités Subaquatiques, or World Underwater Federation. They had competitions called static apnea, dynamic apnea, and bi-fins. So I decided to compete in these events. Then I found out there was also a discipline called variable weight apnea, which is basically diving with a monofin to go deeper. That sounded interesting to me because I used to train with dolphins when I was younger, so I thought it would be fun to try to get back to diving with dolphins. When I tried to find information on the internet - there wasn't much - so I wrote to the president of the AIDA, which is the Association Internationale pour le Développement de l'Apnée, which is the international governing body for freediving. His name is Umberto Pelizzari from Italy. He actually responded to me and sent me some rules. After that, I competed in the national championship.
-### TYLER SWIFT: What is meant by Static Apnoea? What are the Rules?</s><s>
-### LAKE: You just lie flat on your back, and you take a deep breath, and then you wait until you run out of air. Your score is determined by how many seconds it took you to reach unconsciousness.
-```
-
-To try this out in text generation webui load this repo's Lora onto Llama-2-13b and then start out in the Notepad tab with:
-```
-<s>### CONVERSATIONS WITH TYLER SWIFT ###
-
-TITLE:
-```
-
-Then add your custom title (after one space) following the word "TITLE:" and then it should be able to run with that content.
-
-If it forgets to put a name in the description, it might have trouble naming the other guest(s) later. So you should manually add a guest if that happens.
-
-Also, don't forget to manually add a "\<s\>\</s\>" before continuing after it halts at the end of the latest T-Swift generation.
+- PEFT 0.5.0

adapter_config.json

@@ -0,0 +1,21 @@
+{
+  "auto_mapping": null,
+  "base_model_name_or_path": "models/h2oai_h2ogpt-4096-llama2-13b",
+  "bias": "none",
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "lora_alpha": 1024,
+  "lora_dropout": 0.7,
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 1024,
+  "revision": null,
+  "target_modules": [
+    "q_proj",
+    "v_proj"
+  ],
+  "task_type": "CAUSAL_LM"
+}

adapter_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b9fc45309c0487034c1389b8dc786ab5c83c8bce13b7d092b238eb54d4f255a3
+size 3355498893