model update

README.md

@@ -0,0 +1,144 @@
+
+---
+license: cc-by-4.0
+metrics:
+- bleu4
+- meteor
+- rouge-l
+- bertscore
+- moverscore
+language: en
+datasets:
+- lmqg/qg_tweetqa
+pipeline_tag: text2text-generation
+tags:
+- question answering
+widget:
+- text: "question: What is a person called is practicing heresy?, context: Heresy is any provocative belief or theory that is strongly at variance with established beliefs or customs. A heretic is a proponent of such claims or beliefs. Heresy is distinct from both apostasy, which is the explicit renunciation of one's religion, principles or cause, and blasphemy, which is an impious utterance or action concerning God or sacred things."
+  example_title: "Question Answering Example 1" 
+- text: "question: who created the post as we know it today?, context: 'So much of The Post is Ben,' Mrs. Graham said in 1994, three years after Bradlee retired as editor. 'He created it as we know it today.'— Ed O'Keefe (@edatpost) October 21, 2014"
+  example_title: "Question Answering Example 2" 
+model-index:
+- name: lmqg/bart-base-tweetqa-question-answering
+  results:
+  - task:
+      name: Text2text Generation
+      type: text2text-generation
+    dataset:
+      name: lmqg/qg_tweetqa
+      type: default
+      args: default
+    metrics:
+    - name: BLEU4
+      type: bleu4
+      value: 33.57
+    - name: ROUGE-L
+      type: rouge-l
+      value: 58.37
+    - name: METEOR
+      type: meteor
+      value: 32.39
+    - name: BERTScore
+      type: bertscore
+      value: 93.84
+    - name: MoverScore
+      type: moverscore
+      value: 78.67
+    - name: AnswerF1Score (Question Answering)
+      type: answer_f1_score_question_answering
+      value: 64.79
+    - name: AnswerExactMatch (Question Answering)
+      type: answer_exact_match_question_answering
+      value: 48.38
+---
+
+# Model Card of `lmqg/bart-base-tweetqa-question-answering`
+This model is fine-tuned version of [facebook/bart-base](https://huggingface.co/facebook/bart-base) for question answering task on the [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) (dataset_name: default) via [`lmqg`](https://github.com/asahi417/lm-question-generation).
+
+
+### Overview
+- **Language model:** [facebook/bart-base](https://huggingface.co/facebook/bart-base)   
+- **Language:** en  
+- **Training data:** [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) (default)
+- **Online Demo:** [https://autoqg.net/](https://autoqg.net/)
+- **Repository:** [https://github.com/asahi417/lm-question-generation](https://github.com/asahi417/lm-question-generation)
+- **Paper:** [https://arxiv.org/abs/2210.03992](https://arxiv.org/abs/2210.03992)
+
+### Usage
+- With [`lmqg`](https://github.com/asahi417/lm-question-generation#lmqg-language-model-for-question-generation-)
+```python
+from lmqg import TransformersQG
+
+# initialize model
+model = TransformersQG(language="en", model="lmqg/bart-base-tweetqa-question-answering")
+
+# model prediction
+answers = model.answer_q(list_question="What is a person called is practicing heresy?", list_context=" Heresy is any provocative belief or theory that is strongly at variance with established beliefs or customs. A heretic is a proponent of such claims or beliefs. Heresy is distinct from both apostasy, which is the explicit renunciation of one's religion, principles or cause, and blasphemy, which is an impious utterance or action concerning God or sacred things.")
+
+```
+
+- With `transformers`
+```python
+from transformers import pipeline
+
+pipe = pipeline("text2text-generation", "lmqg/bart-base-tweetqa-question-answering")
+output = pipe("question: What is a person called is practicing heresy?, context: Heresy is any provocative belief or theory that is strongly at variance with established beliefs or customs. A heretic is a proponent of such claims or beliefs. Heresy is distinct from both apostasy, which is the explicit renunciation of one's religion, principles or cause, and blasphemy, which is an impious utterance or action concerning God or sacred things.")
+
+```
+
+## Evaluation
+
+
+- ***Metric (Question Answering)***: [raw metric file](https://huggingface.co/lmqg/bart-base-tweetqa-question-answering/raw/main/eval/metric.first.answer.paragraph_question.answer.lmqg_qg_tweetqa.default.json) 
+
+|                  |   Score | Type    | Dataset                                                            |
+|:-----------------|--------:|:--------|:-------------------------------------------------------------------|
+| AnswerExactMatch |   48.38 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) |
+| AnswerF1Score    |   64.79 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) |
+| BERTScore        |   93.84 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) |
+| Bleu_1           |   54.68 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) |
+| Bleu_2           |   46.42 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) |
+| Bleu_3           |   38.97 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) |
+| Bleu_4           |   33.57 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) |
+| METEOR           |   32.39 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) |
+| MoverScore       |   78.67 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) |
+| ROUGE_L          |   58.37 | default | [lmqg/qg_tweetqa](https://huggingface.co/datasets/lmqg/qg_tweetqa) |
+
+
+
+## Training hyperparameters
+
+The following hyperparameters were used during fine-tuning:
+ - dataset_path: lmqg/qg_tweetqa
+ - dataset_name: default
+ - input_types: ['paragraph_question']
+ - output_types: ['answer']
+ - prefix_types: None
+ - model: facebook/bart-base
+ - max_length: 512
+ - max_length_output: 32
+ - epoch: 3
+ - batch: 32
+ - lr: 0.0001
+ - fp16: False
+ - random_seed: 1
+ - gradient_accumulation_steps: 2
+ - label_smoothing: 0.15
+
+The full configuration can be found at [fine-tuning config file](https://huggingface.co/lmqg/bart-base-tweetqa-question-answering/raw/main/trainer_config.json).
+
+## Citation
+```
+@inproceedings{ushio-etal-2022-generative,
+    title = "{G}enerative {L}anguage {M}odels for {P}aragraph-{L}evel {Q}uestion {G}eneration",
+    author = "Ushio, Asahi  and
+        Alva-Manchego, Fernando  and
+        Camacho-Collados, Jose",
+    booktitle = "Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing",
+    month = dec,
+    year = "2022",
+    address = "Abu Dhabi, U.A.E.",
+    publisher = "Association for Computational Linguistics",
+}
+
+```

config.json

@@ -1,5 +1,5 @@
 {
-  "_name_or_path": "lmqg_output/bart-base-tweetqa-question-answering/best_model",
+  "_name_or_path": "lmqg_output/bart-base-tweetqa-question-answering/model_tsaioi/epoch_2",
   "activation_dropout": 0.1,
   "activation_function": "gelu",
   "add_bias_logits": false,

eval/metric.first.answer.paragraph_question.answer.lmqg_qg_tweetqa.default.json

@@ -0,0 +1 @@
+{"validation": {"Bleu_1": 0.5680924777472788, "Bleu_2": 0.48516016586540583, "Bleu_3": 0.40047344437067894, "Bleu_4": 0.33073022279409037, "METEOR": 0.33891182996418623, "ROUGE_L": 0.6021708028939458, "BERTScore": 0.9381738608603539, "MoverScore": 0.7944137348341341, "AnswerF1Score": 66.88579887474913, "AnswerExactMatch": 52.302025782688766}, "test": {"Bleu_1": 0.5467908240543046, "Bleu_2": 0.46421662736218966, "Bleu_3": 0.38966324876067954, "Bleu_4": 0.3356541667545642, "METEOR": 0.32393699677472026, "ROUGE_L": 0.5837067969041474, "BERTScore": 0.9383653925541333, "MoverScore": 0.7866586761784162, "AnswerF1Score": 64.78621959918708, "AnswerExactMatch": 48.37905236907731}}

eval/samples.test.hyp.paragraph_question.answer.lmqg_qg_tweetqa.default.txt

@@ -0,0 +1,1203 @@
+facebook
+5
+5
+5 years in 5 seconds
+southwest airlines
+for maintenance checks.
+crYING
+she is crying.
+blank space
+taylor
+until tomorrow
+37500
+zach lowe
+never made a rule change
+after the flight
+after the flight
+25%
+25%
+portland
+portland
+washington post
+his poll numbers
+jeff gordon
+sideburns, mullet and a taxi cab
+tweet is not visible
+tweet is not visible
+saturday night live
+donald trump
+south carolina
+pick cotton
+china
+in the winners ROOM
+at the top of a staircase
+southampton
+ticket refunds
+ew
+16
+an adult day care center
+the white house
+ migrants and refugees
+serbia-croatia
+lauren hill
+their officers
+an apology
+an offense their officers took
+the dumb media
+dumb
+ consistency
+atletico
+ Durbanites
+ immigrants
+scotland
+panmure golf club
+willow seeds
+snow
+west boca
+u.s. marshals
+going to the white house
+white house
+one year
+the girls.
+chris rock
+the oscars
+jharrison9292
+Steelers
+put her face on a shirt
+paul walkers
+he died.
+beautiful person and talent
+paul walkers death
+beautiful
+that they make the right choices
+their stressful jobs
+a sandwich
+a broomstick
+megyn kelly
+fox news
+roger rees
+a friend and colleague
+it will happen here
+the internet
+kkk jokes
+her brother-in-law
+kellyanne conway
+britney ever after
+stop
+kanyewest
+donald trump
+russian
+PM
+the duke and duchess of cambridge
+disgusting
+nytimes
+bOOYAH
+zero guns, zero knives and 2 hands
+potus
+he led and served our country
+he is trending.
+eric the actor
+eric the actor
+the democrats
+because so many obama democrats voted for him.
+years
+michigan, Ohio, penn and a second term
+the daily show
+europe
+Group B
+2:37 pm
+Group B
+another spider-man movie reboot
+josh Peck and drake bell
+josh Peck got married
+philly
+1,000
+jacob lescenskii
+good job
+beyonce
+slurpee
+Plugged in source
+90 percent
+isis
+Mosul
+haradh
+30
+every moment I exist is agony
+katy
+her son
+a couple
+ presents
+new owners and new management team
+read about it here
+caterham
+that john heilemann was dishonest.
+john heilemann
+@repjohnlewis
+repjohn lewis
+potus
+for statement on nukes
+spend less time voting in the senate
+to spend less time voting.
+they said what so many of us want to say.
+the khan's
+president bling
+on campus
+steve bannon
+in my drafts
+sacramento kings
+Marcus Cousins
+iran
+the nuclear deal
+counts
+switzerland
+honduras
+two
+two
+wilmariel and jason
+orlando's pulse nightclub
+the family
+chester bennington
+ proper eyewear
+the solar eclipse
+make us rich again
+inauguration
+cleveland
+tara the hero cat and family
+bOGO
+the Colombian game
+the Colombian game
+2018
+democrats
+muslim
+mosque
+women who stayed silent
+this is for perspective
+3 feet
+the fcc
+a loss
+senzo meyiwa
+james gunn
+guardians of the galaxy
+the city
+donald trump
+" and then what?".
+good
+iowa
+a winter storm
+miss cleo
+my mom
+zazie beetz
+the next Deadpool
+the thIRD one
+the third one
+the school district
+to get a diplomatic resolution
+sanctions
+beyonce
+solar
+climate action
+at COP22
+paris agreement and climate action
+iraq
+reclaim their territory from ISIL
+kanye
+trump and kanye
+super bowl
+he doesn't like it.
+basic human decency
+ratings
+basic human decency
+work harder
+four
+the red state Gathering
+ben bradlee
+jennifer aniston
+justin Theroux
+beyonce
+grease live
+nytimes critic
+shonda rhimes
+that it is not the type of movie you see in the theaters
+charlotte
+a flower
+he felt that we are all one.
+iJesse williams
+jonathan bennett
+jonathan bennett
+tomorrow morning
+the 40th anniversary.
+the 40
+2015
+boston
+hillary clinton
+philly
+david burtka
+in Italy
+marriage
+in Italy
+reds to Braves
+14 million
+arkansas
+aug 4, 2014
+2
+the real Camelot
+the obamas
+a turn
+youtube
+night
+the crickets
+democrat congresswoman
+zachary hammond
+in the light
+having the opportunity to meet Gordie Howe
+ Gordie Howe
+ peas in guac
+the nyt
+her country
+a bed
+this morning
+bexley Rd
+uk
+mcdonald's uk
+uk
+7:37 pm
+mcdonald's u
+the secretMenu
+mcdonald's uk
+the culture
+@tuckercarlson and @stevehiltonx
+blue
+nicolespag
+true blood
+museum modern art
+big bird and baby bear
+dylan
+her face
+gwen Stefani
+leSean mccoy
+the restaurant receipt thing
+fidel castro
+3 minutes to midnight
+executive director and Publisher
+20 week abortion bans
+it is unpopular
+kept
+her divine right to live
+justin kirkland
+dolores
+cheese dust
+michelle obama
+apples
+ oranges
+the pistons
+reggie jackson
+millions march
+union square
+be silenced
+to take nisa home to palembang
+surabaya
+a little creeped out
+faceID
+atlanta 2015
+google africa
+atlanta
+a stair master
+hell
+hell
+ backup QBs
+patriots
+black protester
+four
+parents
+many years
+a significant milestone
+beam
+andre Iguodala
+kurt helin
+facebook and twitter
+russellcrowe
+prime minister narendramodi
+emotional things
+never showed up
+mariah carey
+brazil
+brazil
+the golf course
+jimmy fallon
+donald trump
+hillary clinton
+hillary clinton
+text dunham to 47246
+dem convention
+a farmer downstream
+loading this beast
+emma watson
+marchers
+because they're scared af.
+tweet does not exist
+tweet does not exist
+natural gas
+we'd stop them faster
+an elephant
+me
+a nap
+a pillow and blanket
+julia louis-dreyfus
+julia louis-dreyfus
+for everyone here in vegas.
+everyone here in vegas
+ republican lefties
+on our money
+eng
+his organization
+an apology
+the Ballon d'Or
+two
+syria
+syria
+Rest in peace
+porto alegre
+full house
+s slanderous
+sen john mccain and all our veterans
+kobani
+ Benghazi
+the cops
+he wished him luck
+he wished him luck
+the cops
+nazis
+the swastika
+uninvited guests
+in restaurants
+a DR pepper
+he died.
+coke
+ immigrants
+at the electoral map
+the entire week
+the show
+he was too busy pulling out pages on evolution
+ autographed it
+his stick
+a young canucks fan
+so he could be in front of NATO group
+ Montenegro PM
+vote for mittromney
+one
+romney
+romney
+romney
+vote for mittromney
+something back
+luis figo
+tony awards2017
+patti luPone
+mourning
+america
+the president
+prince
+prince
+the patriots
+the nfl
+robert kraft
+an apology
+wind gusts
+kenting
+israel
+a warm friendship.
+the wall
+they can continue working on outstanding issues
+thanksgiving
+her father
+two
+start our holiday
+a cat
+very very happy
+andrew Garfield
+Asian
+a warm wind
+42 degrees celsius
+yorktown
+hamilton
+danny Granger/josh mcRoberts
+lebron james
+to figure out why it is being retooled
+google glass
+cesare prandelli
+american horror story
+killing me
+trying to kill me
+lFC
+sunday
+at Anfield
+lFC
+sunday
+ shoreham
+ shoreham
+liberty island
+civilians
+hov
+upload the audio to that Elevator Fight feat.
+fergie
+milf money
+john glenn and Annie
+john glenn
+ariannahuff
+because she is a dog
+someone trying to make him do something.
+he did it.
+an attack
+shameful
+tweet promoting an ad
+ THC
+2.71 inches
+almost 3 inches
+tUES
+in vegas
+2 hours
+trafalgar square bookstore
+on mars
+a man with no legs
+legs
+pac
+he loves pac
+he came out as gay
+tom hitzlsperger
+the mets
+too soon
+the mets
+a tattoo
+the trailer
+a BIG screen
+$125
+t Tupac
+a veterinarian
+the uk
+barf bag
+kim kardashian
+the OG crew
+some things
+in your honor
+ generations of scientists and engineers
+nhl contract
+flapanthers
+mine
+ mixed
+he is complaining.
+brother and half brother
+the evacuated passengers
+travelers beach hotel
+travelers beach hotel
+the evacuated passengers at Travelers beach hotel.
+ unpredictable
+being unpredictable
+anaconda
+ choreo and vid of the year
+to express support
+they appreciate it
+jeb bush
+special interest
+the u.s. embassy
+twitter pic
+cPD
+ 970
+hillary clinton's gold and white
+on April 12, 2015
+the oscars
+2015
+mtv
+the truth
+ben bradlee
+the truth
+ben bradlee
+ misunderstood
+a tweet
+74
+muhammad ali
+lesdoggg
+he passed Consummate NYC actor
+SonyPictures
+steve iran
+a new type
+the 787
+the bachelor finale
+the bachelor finale
+amazon and iTunes
+his fans
+beyonce
+twins
+20
+the notorious b.i.g
+forever
+private
+democrats
+shutdown
+at a time we need it most
+7:37 pm
+#homesweethome
+bullying
+laverne cox
+jeff flake
+stan freberg
+stan freberg
+269
+FCBarcelona
+kris jenner
+kris jenner
+ Apple
+made the biggest, coolest, sexiest, funniest movie ever
+gwen stefani
+blake
+they lost contact.
+ Amsterdam
+us presidents
+three
+go black and never go back
+Dean
+blogging
+posting
+release
+charlotte
+giving cars away
+car
+women have a family to feed
+their privilege
+barbie
+buying her daughter a barbie
+kat graham and dshippjr
+code
+ STEM
+like a king
+justin
+checked the forecast
+ky
+jaz em
+the people that have inspired him
+buzzfeed team
+buzzfeed team
+b BuzzFeed
+an amazing November
+delusion
+ted cruz
+ passive aggressiveness
+her daughter
+in vegas
+dwyane wade
+vfWManeEvent supporters
+vfWMane
+before photos
+before photos
+disappointed
+rickie fowler
+cannot conclude
+cannot conclude
+in the Tony awards press room
+thanking people
+once
+half as much
+beautiful
+george
+super bowl
+47
+an acoustic
+lady gaga
+core mission
+today
+the SEC championship game
+jim m elwain
+washington wizards
+chicago
+ Bulls fans
+the st louis blues camp
+a Stanley cup
+he passed away
+everyone
+to win the Arc
+yuichi Fukunaga
+yuichi Fukunaga
+kuzma
+vote your conscience
+your conscience
+amped up
+a pep talk from the Hanson brothers
+the Hanson brothers
+johnstown, PA
+t Tsarnaev
+rolling stone
+one
+reach out to those affected
+ Marcus morris
+aaron gordon
+kaley cuoco
+long ago
+president of kiev
+ scenes in kiev
+bringing a son into this world
+bringing a son into this world
+hulk
+hulk
+this one celebrating X's victory
+x's victory
+x
+bill murray
+trump's jock
+mccain's or k Kasich's socks
+chiraq
+because of gun violence
+leslie jones
+he needs to be arrested and prosecuted
+all of us
+in our city
+207
+207
+chris martin
+getting divorced
+insufferable similarities
+10 minutes
+the bachelorette finale
+by midnight
+by midnight
+president
+russia
+russia
+#charliehebdo
+andrew lesnie
+your humor and love
+coaches in college or pro sports
+geno auriemma
+dunkin donuts
+starbucks
+hassan rouhani
+two
+Eva Longoria
+a cheese baby
+pregnancy
+iowa
+road trip
+heat
+model
+california
+change
+that it would benefit the wealthy over the middle-class.
+hawaii
+when will the law take effect
+by reporting them
+rape
+the best designer
+the best designer
+4-3-3
+4-3-3
+j_klinsmann
+j_klinsmann
+congressman john lewis
+john lewis
+mike munchak
+5 hours
+ Copper Breaks
+grasshoppers & beetles
+justin kirkland
+Raven gates09
+nyc Ebola patient's
+ebola patient's footseps
+political Ides of March
+in the upcoming weeks
+a sniper
+7k miles
+in homage
+super bowl
+william and harry
+his father
+fATHER
+william and harry
+police
+they didn't ask if you're black or white
+obama
+racial animus
+Hijacking
+ebrahim airlines
+bryce dhoward
+rancehoward
+your support
+ Lunch time
+the skin
+under my fingernails
+crying
+tear gas
+Nazem Kadri
+cross-check
+Hungary
+tom & jerry
+charlottesville
+unite the country
+good sex
+sorry
+what her mum says
+pittsburg
+new york slough
+they finished goalless.
+bayern
+on the phone
+july
+ Chain & lottery were made worse
+daca
+wall
+pregnancy
+he wants pics.
+movie going experience
+amc
+as much as poss
+more meaningful things
+emotional
+hectoring and yelling
+hectoring and yelling
+syrian envoy to the UNSC
+fallujah, Iraq
+islamic PMU
+syria
+bronaventure
+in a movie
+pay
+pATERnITY leave
+mama June
+introducing the new me
+Raise your hand
+ academia
+saw the stiller@meara open
+the Sands Hotel in vegas
+he thinks it's compassion.
+3 Republicans and 48 democrats
+joe biden
+paul ryan
+ Adidas
+#bring back our childhood
+1.5m
+obese
+obesity
+the Beatles
+after the sING premiere
+the intro
+janet mock
+grace lee whit Whitney
+grace lee whit Whitney
+the new george michael single
+george michael
+after the fantasy draft
+honda
+he smiled
+the hollywood bowl
+the Browns
+colin kaepernick
+ruby rose
+social media
+the new york Rangers
+tbay
+a gym
+Motion
+sen john mccain
+meghan mccain
+gaby amarantos
+@gabymarantos and @tottustu
+ciara
+baby Future
+loss of life
+attack
+zordon
+power rangers
+justin
+for his safety
+nigerians
+#bring back our girls
+tweet sometimes
+tweet
+fake news
+assad
+great
+in a beautiful picture
+james bin zayed
+ Ministers
+with a spirit of change and progress
+the new Ministers
+the lakers
+in 2018 free agency
+louis
+basketball
+the Pacers and the clippers
+snl
+snl
+he feels it is an awesome compliment.
+alan rickman
+a funny and engaging person
+dana harper music
+season 11
+greg schiano
+three
+death row records
+beats by Dre
+beats by Dre
+michael jackson
+james Bond
+it is where the trump budget belongs.
+the house of Representatives
+66-57
+flint
+political statements and finger pointing
+long shirts
+find her
+mama
+tapping
+tapping
+ Arnold schwarzenegger
+swamped
+6
+ legalize DACA
+beyonce
+the super bowl
+american black
+america
+how to sit like a lady
+miss america
+Moon Jae-in
+pyeongchang2018
+the emma
+bringing a flask
+sad
+exclamation points
+strong
+twitter
+in heaven
+jimmy d Dickens
+pickin & grinnin
+in heaven
+damaging coal country
+coal country
+oliver sacks
+ boyish enthusiasm
+bear cam time
+bear cam time
+exploreorg
+music
+the voice
+cavs
+the red carpet
+hidden fences
+the aacopd
+Comey
+confidence
+nostayingathome
+van Gaal
+united
+arsene ar Wenger
+this summer
+vOTER fRAUD
+voting in two states
+incredible progress
+kevin hart
+google maps
+pacman
+cnn
+who is her bestie?
+her/him
+5min
+soccer
+soccer
+5 minutes
+ed sheeran
+Game of thrones
+the shark
+ed Sheeran
+hat
+pharrell
+alex gavan
+the heli
+that he was golden.
+rippaulwalker
+that he was golden.
+so effortlessly golden
+rippaulwalker
+golden
+barrett sallee
+niece and nephew
+measured and inclusive
+michael chertoff
+measured and inclusive
+michael chertoff
+2:30 am
+jFK
+every article I've read
+3:37 pm
+being shocked he won
+it was surprising.
+2
+under a boulder
+philae
+chester bennington's passing
+chester bennington
+families
+4 boys
+gaza beach
+ Loving the pictures
+@SI_swimsuit
+ Messiah
+ Messiah
+an interview and a major photo shoot
+the chapter on cross dressing.
+gop
+luis figo
+the next FIFA president
+joseph fiennes
+justin beiber
+selena gomez
+laVar ball
+charles bl Barkley
+the depiction of religion
+yaya toure
+eric Garner died.
+selling cigs
+men
+rrsd julien
+50 shades
+50 shades
+earthquake
+this morning
+cockefeller center
+pacman
+on the highway
+bonnieville & etown
+as a US senator
+cruz
+the section 5 public order act
+ Brighton magistrates court
+colin kazim-richards
+the section 5 public order act
+marcheRepublicaine
+marcheRepublicaine
+houston
+$500,000
+the brain
+human rights issues
+christina Aguilera's Whitney houston tribute
+christina Aguilera
+will smith
+new orleans
+that pesky products on high shelves
+in-store
+yale
+for removing pane of slaves picking cotton.
+germany and germany
+rand paul
+for the good of the party
+2
+mid-November/late-December
+late-November/late-December
+late-November/late-December
+late-November/late-December
+mid-November/late-December
+97
+you don't drink
+the cops
+the cops
+fabricate
+his humor, talent, and capacity to love
+a brother
+streamlining the annulment process
+the annulment process
+francis
+made his own
+it's okay
+in a bowling alley
+what is she taking here
+mel tillis
+good luck with this guys
+c Cantor
+enes Kanter, willy hernangomez and joakim noah
+center
+germany
+underpants
+eggy's hair
+unIVERSITY of wASHINGTON
+gay people
+people
+they're throwing a pizza party
+because of weather
+anti-racist
+Mario Balotelli
+racists
+a tv show
+she had an abortion
+being openly heterosexual
+matt Damon
+pence
+he doesn't know.
+push his head down in a car
+james Franco
+making a mistake
+he doesn't agree
+#rupertsfault
+christian
+10pm
+the fake news show
+press the wrong button
+man
+when he died.
+mike Porcaro
+over the line
+power
+meryl
+take her seat
+his spouse or kids
+ted cruz
+it's not acceptable.
+since 2007
+Letterman
+the dial
+take over
+twizzlerchallenge
+black hole merging
+cybersecchallenge
+orange team
+white supremacists
+the president
+before they die
+ass reporters
+#oscars
+lady gaga's oscars look
+his children
+left-wing hypocrisy
+a380
+a380
+negotiate
+terrorists
+mpireFOX
+the finale
+stay safe.
+tomorrow
+everyone
+that he was consciously thinking of it.
+mcIlroy
+senate majldr mcconnell
+7 years
+cindymannings
+ Rahman suspects
+facebook
+facebookdown
+a great healthcare plan
+a great healthcare plan
+get together and piece together a great healthcare plan
+toffs
+transparency
+there is not a tweet here
+nypd
+brian moore
+over 200
+phasing down hFCs
+leonard
+millions
+lebron james
+chris broussard
+English and Spanish
+sophie cruz
+a dog
+betty williams
+las vegas' visual fabric
+promoting
+media attention
+jessica lange
+bruce jenner
+around the globe
+laughing
+vote
+he died.
+facebook
+how to survive facebook going down
+sorority
+looks like a grandmother.
+ted cruz
+donald trump
+because of the controllers strike
+in the airport
+netanyahu
+for his speech to congress
+bakery
+food
+baking
+september 24, 2014
+four months
+four months
+bETA
+during jay z and beyonce clip
+pilgrim
+navy SEALS
+15 years
+the united states
+two
+Ship them
+sam tageson
+what you have
+his loved ones
+the messages of support, love and encouragement
+pratt
+spielberg
+a partisan
+a grand slam
+netflix
+how to get away with murder
+dallas police shooting
+obama
+katie holmes' golden pants
+katie holmes
+corey menafee
+corey menafee
+uschamber
+better and stronger trade deals
+flint
+flint
+2016
+shark
+the bachelor producers
+dem
+he was wrong
+his rapist
+hollywood/media
+tomi lahren
+obamacare
+female
+female
+airplane seats
+movie theater
+impeachment ofDonaldTrump
+play racist calls
+ defending champ murray
+ Dimitrov
+paulwalkerfdn
+paulwalkerfdn
+ebola
+winnipeg
+kampala Serena
+the kayoola solarbus
+tuesday
+pat sajak
+the Wheel of Fortune
+another plane
+they vanished
+crazy
+people
+hard but liberating
+watching the evening news
+south africa
+every Praise
+mike brown
+to the movement house
+farmers
+plowing up dirt
+creme eggs
+kim kardashian pierced her daughters ears
+kim kardashian
+justin bieber
+myspace
+margot
+he is glowing
+the National Weather Service map
+spend his life serving something more important than himself
+john mccain
+a bit player

eval/samples.validation.hyp.paragraph_question.answer.lmqg_qg_tweetqa.default.txt

@@ -0,0 +1,1086 @@
+megynkelly
+her hidden agenda
+people
+coachella
+a very good role model
+a good role model
+natalie portman
+saturday night live
+self
+trump
+full of spice
+in the shower
+ Saturday Night Live
+three
+who she is
+trump
+he has news
+freedom
+5 years
+the bachelor
+basketball
+a win
+ thoughtful, committed
+small
+love
+hate
+ryan
+jazz
+kanye jokes
+stay in your seat, kanye
+dad
+his first Celtics jersey
+the children
+ heteronormative
+obama obama
+mr. president
+the candle
+peachcandle
+women
+women
+abUSE of POWER
+baton rouge
+black panther
+a deep bench
+Hidden fences
+michael keaton
+$1
+smosh
+spider mable
+black cat
+14th Atlantic
+14
+blue Wonderful
+the Sunset Strip
+he knows what happened
+verizonstrike
+boston
+martin luther king
+sharing the play.
+very excited
+two
+bodega
+a no-move clause
+three
+the magazine
+his shirt
+equal time
+an apology
+zero
+cnn
+the pizza and the dog
+the right thing
+everyone makes mistakes
+frank luntz
+the debate
+jacoby ellsbury
+1st
+michelle obama
+women in film award
+mrdrewscott
+watch and vote
+simone biles
+her best bar
+alessiacara
+crowd
+dove
+out of this world
+out of this world
+ Erdogan
+export abuse
+a copy
+donald trump
+lislis kudrow
+smelly cat
+the grammys
+1997
+at the Arena
+vancouver
+what akers just saw
+he is akers
+61 years
+europe
+words
+in the movie
+david levitz
+stick together
+elling yelling
+stunts
+until we are old enough to vote
+mayor mark
+the white house
+the white house beer
+6,000
+black
+chicago
+whites
+2
+deprogram b4
+to protect the american people
+ helping economy and bringing back jobs
+congress
+a great start
+a massive expansion of retraining and counseling
+the police force
+@usatopinion
+he was fine with it
+cellphones
+police patrols
+chrisrock
+chrisrock
+ Iroquois high school
+jimmy fallon
+kevloria Discovery
+kevloria Discovery
+chrishemsworth
+a sweet Viennese waltz
+the golden ticket
+james comey
+the press
+serenawilliams
+to see you
+kerrywashington
+red
+the jury
+the murder
+man of STEEL
+a prequel
+paul george
+tmobile custs
+golden globes
+cathy Lanier
+26 years
+paris
+paris
+buckingham palace
+the royals
+greatness
+a video
+2017
+9
+tinder
+to meet people and have dates
+president
+down the road
+the economy and AHCA
+making things better or worse
+the media
+dc
+10 years
+anthony mackie
+a bright, brilliant talent
+he died.
+anton Yelchin
+charlie Bartlett and house of d
+10,000
+the Buffalo Sabres
+president
+1000s
+his home rink
+a Apple watch
+Apple watch
+dunkirk
+what do they want to know from harry styles
+sen gillibrand
+sen gillibrand
+a sad story
+arie
+17 hours
+power
+oprah
+ juggling it all with two hands
+at least 7
+mayor of london
+WMU football
+bb
+a thousand notes
+BREAKING BAD
+2008-13
+the mnugga
+the "mcnugga"
+five
+coldplay
+this secret
+better and better
+32 miles
+ helicopter pilot
+best
+your kind words
+purple
+kate Gosselin
+rock the Casbah panel
+bill murray
+an impassioned
+players at texas
+billboard
+break free
+everyone must vote
+alabama
+build the wall
+summer
+zendaya
+miranda
+with a pretty pink ring
+more shootings and more death
+they want them to stop
+sundance
+switzerland
+thinkpieces
+fyre
+the mo state fair
+to visit north stl county
+steve bannon
+casting zoe saldana
+zoe saldana
+gold
+charlie coyle
+duncan kelly
+1st intermission
+the new addition to the peps zamboni
+donald trump
+pizza rat
+bylsma
+malkin and Crosby
+when does beyonce get here
+landondonovan
+@lagalaxy
+dERSHOWITZ
+cassell
+he is living his best Super Bowl EVER
+dancing
+martin luther king
+love
+ Planned Parenthood and ocare
+d.c.
+4th of July
+taylor swift
+disgusting
+trump supporters
+sam Bee
+conanobrien
+bb-8
+starwars cast
+obamas
+ nicest
+trying to undermine democracies
+ Sherlock holmes
+doris roberts
+death
+london
+"No Frauds"
+lebron 9
+ Carlton
+hotline
+657
+with "k"
+westgate
+westgate
+duchess of cambridge
+love it
+ed sheeran
+the riverlands
+ed sheeran
+gossip girl
+anxiety
+what it's like
+ 1903
+1883
+isac_h_wright
+a reality show
+the best
+being his number one cheerleader
+a tickle
+manilla
+biden
+everything she wants to say
+everything
+brangelina
+iowa flag
+at midfield
+sen rand paul
+4/25
+two more
+sharks
+the national anthem
+houston
+excitement
+bio
+y'all
+corinne foxx
+miss golden globes 2016
+a meme
+driving students around
+the PCL
+michael phelps
+kDTrey5 and deandrejordan6
+james harden
+win or the end of the season
+for clarification
+nail polish
+theshoe
+they are wrapped in a circle of paranoia.
+a former ice cream store
+local
+RogersArena
+pat quinn Way and Griffiths Way
+tick "white british"
+from now on
+ciara & russell
+his kids
+the 15th
+ 174 yards
+goOD MORNING RUPAUL's DRAG race
+gaga
+ floored me
+heels
+ Wonder Woman
+martin
+the goals
+jsyk
+1032 am
+obama
+trump's presidency.
+the women's uk hockey program
+gordon hayward
+l.a.
+preacher lawson
+tyrabanks
+greg cosell
+football
+sacramento
+the radio station
+the drama
+justin party
+he is risen
+a candy egg delivering plushy bunny
+thanksgiving
+an undercover robot
+a girl
+liam payne
+artist
+hate speech
+emu's king hall
+van canucks
+pat quinn
+mlk
+#mlkday
+hard times
+his place in nichols
+the maks
+maksim
+section 104
+hemsworth
+ Ruffalo
+an auctioneer
+halloween
+harden
+two
+chrishemsworth
+chrishemsworth
+nickkroll and Stephen at home
+david letterman
+fred armisen
+difficult people
+over 200
+over 200
+jimmy kimmel
+for the effort
+grace vanderWaal
+make her famous
+mr. alcohol
+emilia charles
+eyes
+a dream
+this POLICE man
+right now
+hurricane harvey
+mike nichols
+comedian albums
+a scarves and jacket
+june
+shia lebeouf
+how it can be manipulated and orchestrated
+new york
+hopeful
+@Electricmayhem
+a song to release on christmas
+violence
+short skirt
+christine teigen
+a song.
+doloresoriordan
+islandrecords
+dylan
+ rumors
+paul mccartney
+a career
+their contempt
+the billionaire class
+donald glover
+Han Solo
+ed Sheeran
+Ask sheev
+the oLYMPICS
+the olympics
+nola
+joel Embiid
+ covfefe
+ covfefe
+ann coulter
+right now
+dave Mustaine
+star trek
+in the middle of the night
+alabama
+everyone
+you all
+a bow
+you're an independent person
+low
+honor two more legends of our sport.
+the sport
+george r.r. martin
+a heart attack
+larry
+make this about larry
+trump
+mr Burns
+megyn kelly
+a lightweight reporter
+to speak in vague but bombastic generalities
+ vague but bombastic
+patricia arquette
+half
+ceelo
+a MK purse
+sdcc 2
+starwars
+eagles fans
+over 80
+everything they could grab
+ivy park
+logic301
+blakelively
+wishing he looked like blakelively
+chrissy teigen
+150
+he has a mustache.
+henry cavill
+trevor story
+rockies
+donna the elephant
+sad
+luke Donald
+vino
+he can't f'ing wait
+spit on TV
+la
+john Boyega
+an airport
+ listen to beyonce
+larry
+harry
+tweet did not show
+tweet did not show
+a rematch
+matthew perry
+a year and a half
+record
+warren and faye
+warren and faye
+beauty and the beast
+gay
+space Jam
+kentucky
+the upper hand
+the beyhive
+ Paramount and Warners
+imagining Paramount and Warners
+luke obama
+the character work
+1997
+hiv/AIDS
+nhl management
+excitement
+introducing custom-painted aircraft
+disney's Frozen
+"Do Ya Think I'm Sexy"
+republicrecords
+iowa cafe
+iowa cafe
+donald trump
+four
+istanbul
+turkey and greece
+sanders
+94 crime bill
+the halftime show
+lady gaga
+iowa
+the president
+paul feig
+all-female
+ Alice Oswalt
+in the universe
+timberlake
+country album
+they are done w/ the nhl.
+24/7 Series
+anyone on my team
+james harrison
+16
+vegas
+jeff sessions
+who's been naughty or nice
+jeff varner
+head of Habitat Int'l
+joe biden
+john
+christine teigen
+jonathan drouin
+that he will play on the trip.
+joss whedon
+batgirl
+b Bryzgalov
+the nhl allstar
+words
+their future VPOTUS
+johnlegend
+they are gathered in one place.
+gay men
+gay men
+finding out they broke up
+amanda Berry
+cleveland
+ann Coulter
+delta
+johnny depp
+an outfit he found in Johnny depp's Goodwill donation bag
+kellyanne conway
+the warriors
+jim buss
+keobe bryant
+john williams
+come swim
+kristen stewart
+madison square Garden
+lacey holsworth and her family
+cavs
+cavs
+lebron james
+lebron james
+lebron
+sad
+to spend more time with his pets
+left wing
+violence
+beyonce
+lemonade
+leslie jones
+2
+introducing Harry, Ginny and albus potter
+harry, Ginny and albus potter
+the houston and brown
+tom hiddleston
+seven minutes
+the pens locker room
+live look in
+people's mouths
+the prayers & hymns
+ Hanzal
+boedker
+louis
+@katebolduan
+m Ming Xi
+leslie odom, jr
+ liberation station
+wiggins
+106-106
+106-106
+ Kemba
+ Macedonian and Macedonian
+for taking this photo
+madonna
+malia obama
+malia obama
+malkin
+an MRI
+facebook
+the united states
+marcjacobs
+hillary
+hillary
+rian johnson
+matilda
+ Gryffindor and Ravenclaw
+me
+an homage
+the harlots
+a romphim
+ Raven
+"donald gets things done"
+melania trump
+the Canadian anthem
+sing the Canadian anthem
+a winner
+he messes with rosie.
+michael Dal colle
+ Sonny Milano
+trump
+ Possession of Controlled Substance
+canada
+$250k
+nashville
+taylor swift
+white
+because of race
+target
+kukkatori
+residente's verse
+his wrote my way out verse
+david cassidy
+proud and honored
+maya angelou
+a caged bird
+one year old
+slow down
+sweden
+fox news
+gilmore girls
+gilmore girls
+nope
+ everyday heroes
+strong and full of everyday heroes
+the internet
+net neutrality
+kanye west
+2015
+new york
+devastating
+the cops
+he said he was inWrongSkin
+she got beat up.
+outside with her brothers
+shutup and enjoy the show
+shutup and enjoy the show
+the golden globes
+black
+abc
+arie
+justinbieber
+ whip
+jeff gorton
+11
+the final five
+the floor
+office workers
+san Bernardino
+r-word
+ Paper Towns
+a waterbottle
+downton abbey
+paul walkers
+an accident
+CriticsChoice
+9460 wilshire Blvd
+ screenshot this
+the bachelor
+livia from the bachelor
+steal people's boyfriends
+she ruined it.
+bandages
+kotex
+his family
+he spent yesterday with his family
+casino boat
+50 people
+troops
+prOUdly
+4 inches
+fake
+the patriots
+paul, noma and cherrelle
+harry potter play
+hugh jackman
+gap toothed
+cut in the wall
+a hole in the wall
+every word said
+the pro-am
+tim tebow
+empathy
+christine teigen
+his PR team
+zayn
+trudeau
+the united states
+jules
+priez
+prince doing "rally4peace"
+rally4peace
+selena and abel
+release music together
+lebron james tattoo
+lebron james
+chester bennington
+linkinpark
+eastern michigan university
+racist graffiti
+california
+sad
+texans
+moving out of the 1st pick
+the only colors
+cardinal and gold
+rain & storms
+central & eastern
+benetton
+haley
+a kia
+a kia
+rihanna fans
+rihanna fans
+john lewis
+martin luther king jr.
+russia
+negative
+therealeve
+ dates and RSVP
+elliegoulding
+3/15
+justinbieber is here
+his set
+this nonsense
+dallas
+kim kardashian
+gQ
+purple
+black panther
+iGGY AZalEA
+he enjoyed the holiday season
+call me
+in heaven
+an official statement
+shocked and heartbroken
+show us your best office mugshot
+a coffee prize pack
+donald trump
+for a great speech
+alabama
+20
+beauty and the Beast
+emma watson
+a mini series
+the show
+malcolm young
+ac/dc
+kane
+pretty good
+tom hanks
+2017
+a dear friend
+anne Hathaway
+women syncing periods
+beat him to it
+he is apologizing.
+violence
+jeremy
+3
+redsox
+l Lester and Lackey
+kevin
+wallstar
+speeches
+an american
+to use the restroom
+2014
+in the unlikely event
+2009
+emergency room nurse demographic
+steph curry and under Armour
+steph
+god
+stephen a.
+after shoot-around
+four
+the last
+a conservative
+the russians
+the right side
+black Panther
+black Panther
+summer
+ daily into August
+russell wilson
+mark rodgers
+TCU's punter
+shawn Oakman
+team usa
+team usa lockerroom
+rihanna
+the Met Gala
+vp biden and mariska
+that beautiful scene
+aava
+@ava
+colon cancer
+2
+all of your warm thoughts and well wishes
+getting back to work
+jSU bus
+@NRJAwards2015
+a great time
+the rock hall
+their votes, posts, and videos
+kiss
+a 10
+money23 green
+3
+disney
+ beastiliaty
+the endangered river
+#endangeredriver
+3
+2:19
+grandmother
+ Twenty dollars
+the Duchess of cambridge
+kensington palace
+the Duchess
+a flight simulator
+the democrats
+democrats
+for his resignation
+the president
+mike green
+mike green
+their emotions
+multiple offers
+ Regina george
+election day
+colonel sanders
+a timesup rose
+free and open
+net neutrality
+grease
+her scalp
+the area
+black
+president's motorcade
+to be a las vegas girl
+portia and portia
+ ellentube
+running to each other
+the way they run.
+a hero
+a movie that DELIVERS
+running up to ppl's homes
+it's dangerous
+a free pair of limited-edition @georgehwBush socks
+george hw bush
+her ID
+the white house
+hamburg
+they were hurt.
+ Gilmore Girls
+given me new life
+russian connection
+jim Harbaugh
+national anthem
+nj
+this forecast
+black
+work
+DL champlin
+after everything I've done for you
+realDonaldTrump
+reprehensible, prejudiced and divisive
+it is the right decision.
+the right coach
+starwars
+making their way to show
+hockey
+his Gordie Howe hat trick
+police
+mjolnir
+steve
+protect them
+the family of Seth Thomas
+seth thomas
+gig Harbor
+narrows airport
+tina fey
+ Felicity jones
+today
+the prince of Wales
+jimmy fallon
+nypd hats
+officer moore
+tom hiddleston
+red
+gold
+katieledecky
+tsonga
+before his first match
+greece
+turkey
+he hit by a pitch
+Birmingham area
+Birmingham area
+hailey baldwin
+v
+half-time
+ar
+the Tig
+very sad
+he was such a character
+skydance
+diane keaton
+nyc
+tom hiddleston
+to personalize shopping
+cher
+hospitality
+e Ethan
+a global hack
+the grandchildren
+christmas
+america
+ amber waves of grain
+to report incidents of bias
+because this state celebrates our differences
+ariana grande
+ariana grande
+penguin avenue, Antarctica
+penguin
+an Instagram quality photo
+3 legs
+oprah
+terling k brown
+so proud
+indians
+22
+don graham's farewell party
+an honor
+donald trump
+he would get very mad about it
+jwatt
+an amazing gift
+stephen curry30
+when they grow up
+his neighbor/genius quiara
+sia WEAPONIZES vowels
+a movie
+sUREwalk
+elizabeth
+the bachelor
+the thugs
+white
+jennifer aniston
+in the mountain of despair
+mountain of despair
+a headache
+the amazing news oscar nom
+the Mets
+get a mets tattoo
+jemmye carter
+because of the connection we shared.
+the trophy
+this sunday
+the light
+wow now the light has sold out
+jtimberlake
+new country
+a bill
+martin heinrich
+cattie hallway
+ bathroom counter
+the oscars bar
+1 am
+leaked nudes
+revenge porn
+17's
+yogi ferrell
+the cauldron
+wayne's world
+juggalo march
+america
+the most anti-LGBTQ+ presidential ticket
+they mean nothing to us
+lebron
+that he looked familiar.
+zazie
+domino
+to the beach
+aim
+the app
+the glory of the lord
+all flesh
+sJP
+sarah jessica Parker and george malkemus
+kanye
+dark and multiracial
+kyle chandler
+comey
+zac efron
+on the cheek
+nudes
+bette midler
+kanye
+50 minutes
+ slaughter the competition.
+met gala
+that america is trash
+20 minutes
+new isles
+drinking champagne
+ champagne
+autotune
+he sounds like autotune
+a free pass
+someone's horrible musfortune
+he kissed her
+2016
+security guy
+charlie wang
+seize the means
+the means of production
+ pronouns.
+the third
+shia lebeouf
+singapore
+hop
+someone give her hope
+kim kardashian
+cashing her 80 million video game check
+spotify
+release her album
+benedict cumberbatch and a nice chap
+he plays tennis
+a lot
+an alarming amount
+@dunderswiftlin
+new. LEVEL
+michelle rodriguez
+ matt bomer
+@BMarshall
+tweet
+a podium
+melissa McCarthy/sean spicer
+lowkey
+boogieman
+alexander pettyton
+opening this convo
+beautiful
+alabama
+black women
+the day we become silent
+mlk
+RED CROSS
+the people
+the world
+the world
+the airwaves
+write a book or start a podcast
+young pope
+tomorrow

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:bca0c92d6c2cd914d3222365f61fdf874fefe263e44e954108bce0d91d1f99f2
-size 557970589
+oid sha256:d3a255c8a54f7b1813bce9ba75c483578da8d6b1dcb73482c350d88c562fc890
+size 557974301

tokenizer_config.json

@@ -6,7 +6,7 @@
   "errors": "replace",
   "mask_token": "<mask>",
   "model_max_length": 1024,
-  "name_or_path": "lmqg_output/bart-base-tweetqa-question-answering/best_model",
+  "name_or_path": "lmqg_output/bart-base-tweetqa-question-answering/model_tsaioi/epoch_2",
   "pad_token": "<pad>",
   "sep_token": "</s>",
   "special_tokens_map_file": null,

trainer_config.json

@@ -0,0 +1 @@
+{"dataset_path": "lmqg/qg_tweetqa", "dataset_name": "default", "input_types": ["paragraph_question"], "output_types": ["answer"], "prefix_types": null, "model": "facebook/bart-base", "max_length": 512, "max_length_output": 32, "epoch": 3, "batch": 32, "lr": 0.0001, "fp16": false, "random_seed": 1, "gradient_accumulation_steps": 2, "label_smoothing": 0.15}