H-Huang/complex_word_identification huggingface dataset:
Last month the US expelled 35 Russian diplomats accused of espionage, and sanctioned Russian intelligence agencies.
Target word: expelled — judged complex by 1 of 10 native annotators and 6 of 10 non-native annotators (probability complex: 0.35)
Target word: Last — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: month — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: US — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: diplomats — judged complex by 4 of 10 native annotators and 3 of 10 non-native annotators (probability complex: 0.35)
Target word: Russian — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: diplomats accused — judged complex by 2 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.1)
Target word: accused — judged complex by 2 of 10 native annotators and 1 of 10 non-native annotators (probability complex: 0.15)
Target word: espionage — judged complex by 10 of 10 native annotators and 8 of 10 non-native annotators (probability complex: 0.9)
Target word: sanctioned — judged complex by 8 of 10 native annotators and 4 of 10 non-native annotators (probability complex: 0.6)
Target word: intelligence — judged complex by 4 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.2)
Target word: Russian — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: intelligence agencies — judged complex by 1 of 10 native annotators and 1 of 10 non-native annotators (probability complex: 0.1)
Target word: agencies — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
This was in response to a CIA report issued two weeks earlier that concluded the Russian government hacked servers belonging to the U.S. Republican and Democratic parties.
Target word: response — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: hacked — judged complex by 4 of 10 native annotators and 5 of 10 non-native annotators (probability complex: 0.45)
Target word: CIA — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: report — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: issued — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: weeks — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: concluded — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: Russian — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: government — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: hacked servers — judged complex by 0 of 10 native annotators and 1 of 10 non-native annotators (probability complex: 0.05)
Target word: servers — judged complex by 1 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.05)
Target word: Republican — judged complex by 1 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.05)
Target word: belonging — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: Democratic parties — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: Democratic — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: parties — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
The CIA report said this was to turn the 2016 presidential election toward president-elect Donald Trump.
Target word: presidential — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: CIA — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: report — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: turn — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: president-elect — judged complex by 2 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.1)
Target word: election — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: president-elect Donald — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: Donald — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: Trump — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Since Szydło took office in 2015, Poland has also suffered a decline in relations with Russia.
Target word: Szydło — judged complex by 1 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.05)
Target word: Poland — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: office — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: suffered — judged complex by 5 of 10 native annotators and 3 of 10 non-native annotators (probability complex: 0.4)
Target word: suffered a decline — judged complex by 0 of 10 native annotators and 1 of 10 non-native annotators (probability complex: 0.05)
Target word: decline — judged complex by 2 of 10 native annotators and 3 of 10 non-native annotators (probability complex: 0.25)
Target word: relations — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: Russia — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
[...] Of course, the opinion’s showy profundities are often profoundly incoherent."
Target word: opinion’s — judged complex by 1 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.05)
Target word: opinion — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: showy — judged complex by 0 of 10 native annotators and 1 of 10 non-native annotators (probability complex: 0.05)
Target word: showy profundities — judged complex by 1 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.05)
Target word: profundities — judged complex by 10 of 10 native annotators and 9 of 10 non-native annotators (probability complex: 0.95)
Target word: profoundly — judged complex by 1 of 10 native annotators and 3 of 10 non-native annotators (probability complex: 0.2)
Target word: profoundly incoherent — judged complex by 9 of 10 native annotators and 2 of 10 non-native annotators (probability complex: 0.55)
Target word: incoherent — judged complex by 3 of 10 native annotators and 8 of 10 non-native annotators (probability complex: 0.55)
When the decision was made, police allowed people outside the court to wave the rainbow flag on the court plaza.
Target word: decision — judged complex by 1 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.05)
Target word: wave — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: made — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: police — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: allowed — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: people — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: court — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: rainbow flag — judged complex by 0 of 10 native annotators and 1 of 10 non-native annotators (probability complex: 0.05)
Target word: rainbow — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: court — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: flag — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: court plaza — judged complex by 1 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.05)
Target word: plaza — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Demonstrators outside the court chanted "Love has won".
Target word: Demonstrators — judged complex by 10 of 10 native annotators and 3 of 10 non-native annotators (probability complex: 0.65)
Target word: court — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: chanted — judged complex by 1 of 10 native annotators and 4 of 10 non-native annotators (probability complex: 0.25)
Target word: Love — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: won — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
This decision made the United States the 21st country to legalise same-sex marriage.
Target word: legalise — judged complex by 8 of 10 native annotators and 4 of 10 non-native annotators (probability complex: 0.6)
Target word: decision — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: made — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: United — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: States — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: country — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: legalise same-sex — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: same-sex marriage — judged complex by 1 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.05)
Target word: same-sex — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: marriage — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
President Barack Obama responded to the decision: "Today we can say, in no uncertain terms, that we have made our union a little more perfect."
Target word: responded — judged complex by 1 of 10 native annotators and 2 of 10 non-native annotators (probability complex: 0.15)
Target word: President — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: Barack — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: Obama — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: decision — judged complex by 1 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.05)
Target word: uncertain — judged complex by 2 of 10 native annotators and 1 of 10 non-native annotators (probability complex: 0.15)
Target word: Today — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: uncertain terms — judged complex by 0 of 10 native annotators and 1 of 10 non-native annotators (probability complex: 0.05)
Target word: union — judged complex by 1 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.05)
Target word: terms — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: made — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: perfect — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
After this decision, Facebook introduced a new tool to add rainbow coloring to one's profile picture to celebrate this victory.
Target word: introduced — judged complex by 0 of 10 native annotators and 1 of 10 non-native annotators (probability complex: 0.05)
Target word: decision — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: Facebook — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: profile — judged complex by 1 of 10 native annotators and 1 of 10 non-native annotators (probability complex: 0.1)
Target word: tool — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: add — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: rainbow — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: coloring — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: profile picture — judged complex by 1 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.05)
Target word: victory — judged complex by 2 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.1)
Target word: picture — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: celebrate — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Mark Zuckerberg posted on Facebook "I'm so happy for all of my friends and everyone in our community who can finally celebrate their love and be recognized as equal couples under the law".
Target word: Zuckerberg — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: Mark — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: community — judged complex by 3 of 10 native annotators and 1 of 10 non-native annotators (probability complex: 0.2)
Target word: posted — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: Facebook — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: 'm — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: happy — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: friends — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: recognized — judged complex by 9 of 10 native annotators and 2 of 10 non-native annotators (probability complex: 0.55)
Target word: finally — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: celebrate — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: love — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: equal couples — judged complex by 1 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.05)
Target word: equal — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: couples — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: law — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Everson argues his exclusion violates Title 11 of the U.S. Code of Federal Regulations in that debate hosts must not "structure the debates to promote or advance one candidate over another", and must "use pre-established objective criteria to determine which candidates may participate in a debate."
Target word: argues — judged complex by 2 of 10 native annotators and 3 of 10 non-native annotators (probability complex: 0.25)
Target word: Everson — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: his exclusion — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: exclusion — judged complex by 7 of 10 native annotators and 5 of 10 non-native annotators (probability complex: 0.6)
Target word: exclusion violates — judged complex by 1 of 10 native annotators and 1 of 10 non-native annotators (probability complex: 0.1)
Target word: violates — judged complex by 3 of 10 native annotators and 1 of 10 non-native annotators (probability complex: 0.2)
Target word: U.S. Code of Federal Regulations — judged complex by 1 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.05)
Target word: Title — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: Federal — judged complex by 0 of 10 native annotators and 1 of 10 non-native annotators (probability complex: 0.05)
Target word: Code — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: Federal Regulations — judged complex by 0 of 10 native annotators and 1 of 10 non-native annotators (probability complex: 0.05)
Target word: Regulations — judged complex by 1 of 10 native annotators and 1 of 10 non-native annotators (probability complex: 0.1)
Target word: debate — judged complex by 1 of 10 native annotators and 2 of 10 non-native annotators (probability complex: 0.15)
Target word: structure — judged complex by 0 of 10 native annotators and 2 of 10 non-native annotators (probability complex: 0.1)
Target word: hosts — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: debates — judged complex by 1 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.05)
Target word: promote — judged complex by 1 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.05)
Target word: advance — judged complex by 0 of 10 native annotators and 1 of 10 non-native annotators (probability complex: 0.05)
Target word: advance one candidate over another — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: candidate — judged complex by 2 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.1)
Target word: pre-established — judged complex by 3 of 10 native annotators and 2 of 10 non-native annotators (probability complex: 0.25)
Everson argues his exclusion violates Title 11 of the U.S. Code of Federal Regulations in that debate hosts must not "structure the debates to promote or advance one candidate over another", and must "use pre-established objective criteria to determine which candidates may participate in a debate."
Target word: pre-established objective criteria — judged complex by 2 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.1)
Target word: objective — judged complex by 1 of 10 native annotators and 1 of 10 non-native annotators (probability complex: 0.1)
Target word: objective criteria — judged complex by 1 of 10 native annotators and 2 of 10 non-native annotators (probability complex: 0.15)
Target word: criteria — judged complex by 3 of 10 native annotators and 3 of 10 non-native annotators (probability complex: 0.3)
Target word: determine — judged complex by 1 of 10 native annotators and 1 of 10 non-native annotators (probability complex: 0.1)
Target word: candidates — judged complex by 1 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.05)
Target word: participate — judged complex by 1 of 10 native annotators and 1 of 10 non-native annotators (probability complex: 0.1)
Target word: debate — judged complex by 0 of 10 native annotators and 1 of 10 non-native annotators (probability complex: 0.05)
Everson served as Commissioner of the IRS from 2003 to 2007, during the George W. Bush administration.
Target word: Commissioner — judged complex by 2 of 10 native annotators and 1 of 10 non-native annotators (probability complex: 0.15)
Target word: Everson — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: served — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: IRS — judged complex by 1 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.05)
Target word: administration — judged complex by 3 of 10 native annotators and 1 of 10 non-native annotators (probability complex: 0.2)
Target word: George — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)
Target word: Bush — judged complex by 0 of 10 native annotators and 0 of 10 non-native annotators (probability complex: 0.0)