cometadata/datacite-titles-descriptions-related-identifiers huggingface dataset:
DOI: 10.23721/100/1478958
title: HTTPS Ecosystem Scans

description: This dataset is composed of four parts: parsed certificates, raw certificates, individual scans (status of each responsive host in a single complete scan of the IPv4 address space), and raw ZMap output of TCP SYN scans on port 443. While we have split these into individual parts, the data is optimized for use in a relational database such as PostgreSQL or MySQL. The files certificates.csv.gz, public_keys.csv.gz, and extraneous_extensions.csv.gz contain parsed data from all certificates we have encountered over the course of our scanning. The certificates relation contains all common data found in a certificate (e.g. subject, issuer, etc). The relation is keyed on "id" and is also unique based on SHA-1 fingerprint. The issuer_id attribute is a self-referntial attribute back to the parent certificate's id. Certificates are valided using OpenSSL and recently downloaded root stores. We attempt to validate each certificate against the browser store along with any previously seen intermediate certificates in order to account for missing certificate chains. The validation is represented in the is-*-trusted attributes. We further validate the certificate for other issues (e.g. expiration, invalid signature), not including the trust chain, which is stored in the is-valid and validation-error attributes. The keys relation contains unique parsed RSA and DSA keys and is linked to by certificates.public_key_id == public_keys.id. Other types of keys are noted in the certificates relation, but are not otherwise further parsed. All other non-binary X.509 extensions are stored in the extraneous extensions relation. The scan files we provide contain data about every host that completed a successful TLS handshake on port 443 during a single comprehensive scan of the IPv4 address space. For each host we include: host IP address, certificate ID, the SHA-1 fingerprint of the certificate, and the timestamp at which the TLS handshake was completed. The data specifically originates from a PostgreSQL 9.2 database, whose schema is available in schema.txt, and we recommend for hosting this dataset. Strings are delimited with a double-quote and newlines are replaced with \n. Information about specific fields can be found in schema.txt. ; https-team@umich.edu
DOI: 10.23721/100/1478972
title: Rapid7 Heisenberg Cloud Honeypot cowrie Logs

description: This is an extract from Rapid7's Heisenberg Cloud global network of honeypot agents. It contains log entries from connection attempts to the cowrie honeypot agent running in Heisenberg Cloud and spans November 1, 2016 through November 30, 2016. Honeypot destination node information is limited to the agent identifier (to preserve the anonymity of the external honeypot IP addresses) but source IPv4 data, source port, destination port and other interaction information is provided. The bzip2 archive file extracts to a directory of compressed JSON files. ; research@rapid7.com
DOI: 10.23721/100/1478987
title: ISP Abuse E-Mail Feed

description: This feed is filterable by e-mail address, IP address, or ASN number. This is the master feed for the Twitter “bad abuse” feed and is pulled from live data.
URLs
https://www.webiron.com/abuse_feed/
https://www.webiron.com/abuse_feed/[ip address]
https://www.webiron.com/abuse_feed/[asn number]
https://www.webiron.com/abuse_feed/[e-mail address]
Fields
Log Entry Type – Contains the action. This is either, report sent, report opened, report or if the host has replied with a resolved statement.
Log Time – Time action was done
Attacker IP – The IP reported for issues (lookup link forwards to IP lookup page). The “IP” link filters the feed by the IP while the “lookup” provides more detailed information on the IP
Logged E-Mails – These are either a list of e-mail addresses reported to for the attacker IP or the address that responded to a resolved or opened event. Clicking on an e-mail will filter the feed by that e-mail address.
Log Message – The list of issues reported or an action message
Deliverable – Was the e-mail accepted by the host (this can lead the IP space being added to the BABL RBL)
Days Unresolved – The number of days the issue since the issue was reported to the host
Incidents Reported – The number of incidents reported. Some bots use thousands of nodes rather than heavier concentrations from fewer hosts. The damages are the same however.
 ;
DOI: 10.5281/zenodo.1471430
title: 20th Century Press Archives JSON-LD dump for CdV 2018 Rhein-Main: persons and companies

description: Folder metadata for all person and company folders of PM20, which have publicly accessible documents. Published for the "Coding da Vinci" Hackathon 2018.

For a preview and further information, please see https://github.com/zbw/cdv2018-pressemappe20 (mostly in German)
DOI: 10.6084/m9.figshare.1603022.v1
title: Supporting information for "Neural network and ReaxFF comparison for Au properties, Int. J. Quantum Chem., 116(13), 979–987 (2016)."
DOI: 10.7910/dvn/lh3bdn/3kiq9w
title: G344-C17O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/47yw4x
title: G343.5-13CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/4luwan
title: G344-12CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/bk6mzu
title: G343.5-C17O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/pcqoky
title: G344.5-12CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/qibh40
title: G344-C18O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/u54h1o
title: G344-13CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/zo8ffc
title: G343.5-C18O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/1a3vct
title: G345-12CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/9vi3xr
title: G344.5-13CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/awjwg4
title: G345-13CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/fpdznm
title: G345-C18O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/girdfa
title: G345.5-12CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/jfbipc
title: G345-C17O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/ozqe6j
title: G345.5-13CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/tn0g0s
title: G344.5-C17O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/w1zkms
title: G344.5-C18O_Vfull.tar.gz
DOI: 10.5258/soton/d0562
title: Dataset: membrane thickness, membrane quotient, membrane porosity and membrane permeability of eggs of 5 populations of Atlantic salmon

description: Data contains information on membrane thickness, membrane quotient, membrane porosity and membrane permeability of eggs of 5 populations of Atlantic salmon. Additional data is presented on oxygen requirements derived from the application of the mass transfer theory.Document contains data relating to below linked thesis and paper entitled: "Variation in egg structure among five populations of Atlantic salmon (Salmo salar) influences their survival in low oxygen conditions" to be published in the journal Royal Society Open Science.Information on method of data collection and calculation is available at: https://eprints.soton.ac.uk/id/eprint/413854
DOI: 10.7910/dvn/lh3bdn/akzdld
title: G345.5-C18O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/e1btfg
title: G346-C18O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/mkjhsw
title: G346-13CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/rxauw3
title: G346-12CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/uy88vt
title: G346.5-13CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/xmci4s
title: G346.5-C17O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/xzprvc
title: G345.5-C17O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/z2krfq
title: G346.5-12CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/z8jr2c
title: G346-C17O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/1wr32t
title: G347-12CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/3col6w
title: G347-C17O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/gu3dt6
title: G347-C18O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/jxom3p
title: G347.5-13CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/l4qiln
title: G347-13CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/nsu1wm
title: G347.5-12CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/ojvvqt
title: G347.5-C18O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/qinccq
title: G347.5-C17O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/r1ygzq
title: G346.5-C18O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/5iklqh
title: G348.5-C17O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/eigsrf
title: G348-12CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/lcpeub
title: G348-C18O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/olzrmj
title: G348-13CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/p2kd4o
title: G348.5-C18O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/pnyh8m
title: G348.5-12CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/uc1roj
title: G348-C17O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/zfkbn8
title: G348.5-13CO_Vfull.tar.gz
DOI: 10.5281/zenodo.1471652
title: Среднемесячная Заработная Плата Работников Рф

description: Cреднемесячная номинальная начисленная заработная плата работников в целом по экономике по субъектам Российской федерации в 2013-2018<br>
DOI: 10.5281/zenodo.1471653
title: Среднемесячная Заработная Плата Работников Рф

description: Cреднемесячная номинальная начисленная заработная плата работников в целом по экономике по субъектам Российской федерации в 2013-2018<br>
DOI: 10.7910/dvn/lh3bdn/7v5blb
title: G349-12CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/cqtkcd
title: G349-13CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/gjwugu
title: G349-C18O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/ppokrq
title: G349-C17O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/umqizb
title: G349.5-C18O_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/wuss51
title: G349.5-13CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/y6zyfq
title: G349.5-12CO_Vfull.tar.gz
DOI: 10.7910/dvn/lh3bdn/zteyq1
title: G349.5-C17O_Vfull.tar.gz
DOI: 10.7910/dvn/pc8yln/nnez1v
title: 16ja046_archival_manuscript.pdf
DOI: 10.6073/pasta/e9b7871fc096f4894636ceef4c474a4f
title: North Temperate Lakes LTER: Secchi Disk Depth; Other Auxiliary Base Crew Sample Data 1981 - current

description: Secchi disk depth is measured in the deepest part of each lake for the eleven primary lakes (Allequash, Big Muskellunge, Crystal, Sparkling, Trout lakes, unnamed lakes 27-02 [Crystal Bog] and 12-15 [Trout Bog], Fish, Mendota, Monona and Wingra). The disk is circular, 20 cm in diameter, and has alternating black and white quadrants. It is lowered using a calibrated Kevlar rope to minimize stretching. Readings are made on the shaded side of the boat both with and without the aid of a plexiglass viewer. The points at which the disk disappears while being lowered and reappears while being raised are averaged to determine Secchi depth. Auxiliary data include time of day, air temperature, cloud cover, wave height, wind speed and direction and whether the lake was ice covered on the sampledate. Sampling Frequency: fortnightly during ice-free season - every 6 weeks during ice-covered season for the northern lakes. The southern lakes are similar except that sampling occurs monthly during the fall and typically only once during the winter (depending on ice conditions). Number of sites: 11
DOI: 10.7910/dvn/lh3bdn/8xs7br
title: G348-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/bmhv62
title: G348.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/6hkahi
title: G344-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/d5dovg
title: G344.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/dpqzhu
title: G346.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/e2pr6s
title: G347-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/fv2utk
title: G345-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/oundhm
title: G347.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/wbjndo
title: G345.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/ychrip
title: G346-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/bfsma0
title: G341-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/bvnvts
title: G341.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/ggypux
title: G342-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/gmc45i
title: G342.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/gvfl4i
title: G339-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/kyiuxb
title: G340.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/lcfs7y
title: G343-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/v2emw5
title: G340-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/wo28y1
title: G343.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/zjccqn
title: G339.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/av9pwh
title: G336-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/bww5ws
title: G337-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/dutnww
title: G338.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/hz3fh8
title: G336.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/x6ro2e
title: G338-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/zntpng
title: G337.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/0tqclo
title: G332.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/7vnqm8
title: G333.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/99kryt
title: G335-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/axur52
title: G334-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/mata8p
title: G334.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/mejapo
title: G335.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/qv9dmj
title: G332-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/y5cyzr
title: G333-C18O_Vcrop.tar.gz
DOI: 10.21227/j1t4-k381
title: programableweb

description: Programmableweb
DOI: 10.7910/dvn/lh3bdn/4tbpt5
title: G328-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/6ycgcs
title: G329-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/b0iuil
title: G329.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/bockme
title: G331.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/gi0q1g
title: G330-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/heeury
title: G330.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/hgrq3s
title: G331-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/kszo28
title: G328.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/2q5yua/vm0a4x
title: 17ja035_archival_manuscript.pdf
DOI: 10.7910/dvn/lh3bdn/1wfcgr
title: G324-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/5ksiwx
title: G325-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/bczv1m
title: G324.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/fmzcw5
title: G327.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/gtctz7
title: G325.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/rgdefj
title: G326-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/rpenuv
title: G323.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/tkd3fq
title: G326.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/uhorin
title: G327-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/zqg3hs
title: G323-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/9akgcj
title: G318-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/eyrjxd
title: G319.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/kspwdl
title: G322-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/kzsrq6
title: G322.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/lmhhq3
title: G320.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/p13grw
title: G320-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/wddh7a
title: G321.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/xbotyj
title: G319-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/zlwcrr
title: G321-C18O_Vcrop.tar.gz
DOI: 10.5281/zenodo.1446516
title: Tomographic X-Ray Data Of Time-Dependent 3D Cross Phantom

description: This is the documentation of the tomographic X-ray data of a dynamic cross phantom made available at http://www.fips.fi/dataset.php. The data can be freely used for scientific purposes with appropriate references to the data and to this document in http://arxiv.org/. The data set consists of (1) the X-ray sinogram with 16 or 30 time frames (depending on resolution) of 2D slices of the cross phantom, made by crossing aluminum and graphite sticks in melted candle wax and (2) the corresponding static and dynamic measurement matrices modeling the linear operation of the X-ray transform. Each of these sinograms was obtained from a measured 360-projection fan-beam sinogram by down-sampling and taking logarithms. The original (measured) sinogram is also provided in its original form and resolution.

This new version contains added file DataStatic_560x60.mat  with 80 time frames and DataStatic_1120x60.mat  with 230 time frames. You can run these files with the code example 2, which computes a Tikhonov regularized reconstruction using conjugate gradient algorithm.
DOI: 10.7910/dvn/c0dbae/dkhaik
title: 5.2_bias_simulations-1.tar

description: Run the script here: ~\archive_psnot\5.2_bias_simulations\5.2_bias_simulations.R
Run-time is on the order of 6 hours.
DOI: 10.7910/dvn/c0dbae/iir1hv
title: 5.3_Finkel_et_al_example-1.tar

description: Finkel et al. replication
Run the script here: ~\archive_psnot\5.3_Finkel_et_al_example\finkel_15mar2015.R
Run-time is on the order of 10 minutes.
DOI: 10.7910/dvn/c0dbae/pfrh4x
title: 5.3_Nielsen_et_al_example-1.tar

description: Nielsen et al. replication
Run the script here: ~\archive_psnot\5.3_Nielsen_et_al_example\nielsen_et_al_10jan2018.R
Run-time is on the order of 10 minutes.
DOI: 10.7910/dvn/c0dbae/purtku
title: 4.3_find_hidden_experiments-1.tar

description: Run the script here: ~\archive_psnot\4.3_find_hidden_experiments\find_hidden_experiments_code_10jan2018.R
Run-time is on the order of 6 hours.
DOI: 10.7910/dvn/c0dbae/wvju2p
title: A.1.1_twelve_obs_example-1.tar

description: 12 obs simulation
Run the script here: ~\archive_psnot\A.1.1_twelve_obs_example\twelve_obs_example_11jan2018.R
Run-time is on the order of 10 seconds.
DOI: 10.7910/dvn/lh3bdn/8xaoe6
title: G314.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/bwbgii
title: G317.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/duohtj
title: G316-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/ovyrak
title: G315.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/s2wzp4
title: G316.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/su9lct
title: G318.5-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/uzdm82
title: G317-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/xrsuzw
title: G315-C18O_Vcrop.tar.gz
DOI: 10.7910/dvn/lh3bdn/yu7jht
title: G314-C18O_Vcrop.tar.gz
DOI: 10.5281/zenodo.1472329
title: Crowdtruth Corpus For Open Domain Relation Extraction From Sentences

description: This repository contains a ground truth corpus for open domain relation extraction from sentences, acquired with crowdsourcing and processed with <strong>CrowdTruth</strong> metrics that capture ambiguity in annotations by measuring inter-annotator disagreement.

The dataset contains annotations for 4,100 sentences sampled from Angeli et al. (1) and Riedel et al. (2), over 16 relations, with each sentence annotated by 15 workers. The sentences have been pre-processed with Distant Supervision (3) using the Freebase knowledge base, in order to identify the term pairs in each sentence that are likely to express a relation. The crowdsourced data was collected from Figure Eight and Amazon Mechanical Turk.

This corpus has been discussed in the following papers:


	Anca Dumitrache, Lora Aroyo and Chris Welty: <strong>Crowdsourcing Semantic Label Propagation in Relation Classification</strong>. FEVER Workshop at EMNLP 2018.
	Anca Dumitrache, Lora Aroyo and Chris Welty: <strong>False Positive and Cross-relation Signals in Distant Supervision Data</strong>. AKBC Workshop at NIPS 2017.
	Anca Dumitrache, Lora Aroyo and Chris Welty: <strong>Disagreement in Crowdsourcing and Active Learning for Better Distant Supervision Quality</strong>. Collective Intelligence 2017.


Sentence-level data is available in file: <code>|--data/output/aggregated_sentences.csv</code>

Worker-level data is available in file: <code>|--data/output/aggregated_workers.csv</code>

Raw crowdsourcig data is available in folder: <code>|--data/input/</code>

Results of the relation classification model are available in folder: <code>|--data/model_results/</code>

 

References

(1) Angeli, Gabor, et al. "Combining distant and partial supervision for relation extraction." Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 2014.

(2) Riedel, Sebastian, et al. "Relation extraction with matrix factorization and universal schemas." Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics (NAACL). 2013.

(3) Mintz, Mike, et al. "Distant supervision for relation extraction without labeled data." Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2-Volume 2. Association for Computational Linguistics, 2009.
description: {"references": ["Anca Dumitrache, Lora Aroyo and Chris Welty: Crowdsourcing Semantic Label Propagation in Relation Classification. FEVER Workshop at EMNLP 2018. arXiv:1809.00537", "Anca Dumitrache, Lora Aroyo and Chris Welty: False Positive and Cross-relation Signals in Distant Supervision Data. AKBC Workshop at NIPS 2017. arXiv:1711.05186"]}
DOI: 10.5281/zenodo.1472330
title: Crowdtruth Corpus For Open Domain Relation Extraction From Sentences

description: This repository contains a ground truth corpus for open domain relation extraction from sentences, acquired with crowdsourcing and processed with <strong>CrowdTruth</strong> metrics that capture ambiguity in annotations by measuring inter-annotator disagreement.

The dataset contains annotations for 4,100 sentences sampled from Angeli et al. (1) and Riedel et al. (2), over 16 relations, with each sentence annotated by 15 workers. The sentences have been pre-processed with Distant Supervision (3) using the Freebase knowledge base, in order to identify the term pairs in each sentence that are likely to express a relation. The crowdsourced data was collected from Figure Eight and Amazon Mechanical Turk.

This corpus has been discussed in the following papers:


	Anca Dumitrache, Lora Aroyo and Chris Welty: <strong>Crowdsourcing Semantic Label Propagation in Relation Classification</strong>. FEVER Workshop at EMNLP 2018.
	Anca Dumitrache, Lora Aroyo and Chris Welty: <strong>False Positive and Cross-relation Signals in Distant Supervision Data</strong>. AKBC Workshop at NIPS 2017.
	Anca Dumitrache, Lora Aroyo and Chris Welty: <strong>Disagreement in Crowdsourcing and Active Learning for Better Distant Supervision Quality</strong>. Collective Intelligence 2017.


Sentence-level data is available in file: <code>|--data/output/aggregated_sentences.csv</code>

Worker-level data is available in file: <code>|--data/output/aggregated_workers.csv</code>

Raw crowdsourcig data is available in folder: <code>|--data/input/</code>

Results of the relation classification model are available in folder: <code>|--data/model_results/</code>

 

References

(1) Angeli, Gabor, et al. "Combining distant and partial supervision for relation extraction." Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 2014.

(2) Riedel, Sebastian, et al. "Relation extraction with matrix factorization and universal schemas." Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics (NAACL). 2013.

(3) Mintz, Mike, et al. "Distant supervision for relation extraction without labeled data." Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2-Volume 2. Association for Computational Linguistics, 2009.
description: {"references": ["Anca Dumitrache, Lora Aroyo and Chris Welty: Crowdsourcing Semantic Label Propagation in Relation Classification. FEVER Workshop at EMNLP 2018. arXiv:1809.00537", "Anca Dumitrache, Lora Aroyo and Chris Welty: False Positive and Cross-relation Signals in Distant Supervision Data. AKBC Workshop at NIPS 2017. arXiv:1711.05186"]}
DOI: 10.7910/dvn/c0dbae/2cch0y
title: A.2_psm_extensions.tar

description: PSM Extensions
Run these scripts:
~archive_psnot\A.2_psm_extensions\optimal_matching\find_hidden_experiments_optimal_matching_17oct2018.R
~archive_psnot\A.2_psm_extensions\optimal_full_matching\find_hidden_experiments_optimal_full_matching_17oct2018.R
~archive_psnot\A.2_psm_extensions\CBPS\find_hidden_experiments_CBPS_17oct2018.R
~archive_psnot\A.2_psm_extensions\BiasAdjPSM\find_hidden_experiments_BiasAdjPSM_17oct2018.R
~archive_psnot\A.2_psm_extensions\Genmatch\find_hidden_experiments_Genmatch_17oct2018.R
~archive_psnot\A.2_psm_extensions\Genmatch_with_pscore\find_hidden_experiments_Genmatch_with_pscore_17oct2018.R
~archive_psnot\A.2_psm_extensions\MDM_with_pscore\find_hidden_experiments_MDM_with_pscore_17oct2018.R
Run-time varies by method, but takes between 20 minutes and 12 hours for each script above.
Then run:
~archive_psnot\A.2_psm_extensions\compare_methods_figure_14oct2018.R
Run-time is 10 seconds.