Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
61
datasets available to search
ShareScore release 0.9.0
Dataset results
61 results for “Judgment”
"Vitamin C Deficiency in Hospitalized Adults: Systematic Screening Vs. Traditional Judgment - a Before-and-After Observational Study"
ClinicalTrials.gov study NCT06876545. IPD Sharing: YES. Countries: 1. Publications: 0.
Data from: Viewing images of snakes accelerates making judgments of their color in humans: red snake effect as an instance of ‘emotional Stroop facilitation’
Open the record for dataset details and reuse information.
The reliability of acceptability judgments across languages. Glossa: a journal of general linguistics, 3(1), 100.
<p>Results from The reliability of acceptability judgments across languages. <em>Glossa: a journal of general linguistics, 3</em>(1), 100. DOI: <a href="http://doi.org/10.5334/gjgl.528">http://doi.org/10.5334/gjgl.528</a></p> <p>"Group" is the number of the contrast (referred to in the paper as J4, J5, etc in the paper). In the "member" column, 1 refers to starred and 0 to unstarred.</p>
AREX: AMI Requests for Explanations and Relevance Judgments for their Answers
<p>The AREX dataset was designed to evaluate a question answering system to be used during meetings. The dataset contains 74 excerpts of the AMI Meeting Corpus, with a request for explanation inserted at the end of each excerpt, targeting an acronym mentioned in the excerpt (e.g., “I need more information about RSI”). The goal of the system is to retrieve Wikipedia pages that enable the users to find more information about the acronym and the correct underlying notion in the context of the meeting. The dataset provides relevance judgments from human judges for sets of about thirty Wikipedia pages retrieved for each request by a pool of four systems. Moreover, an evaluation metric comparing two sets of answers based on the human judgments is provided, though other evaluation strategies are possible too.</p> <p> </p> <p><strong>Description</strong></p> <p>The AREX dataset contains the relevance judgments for sets of documents retrieved as an answer to requests for explanation (such as “Tell me more about NTSC”) during group meetings recorded in the AMI Meeting Corpus. Since the number of requests for explanation that occur naturally in the AMI Meeting Corpus is relatively small, we created new requests using the following procedure. We identified sentences containing an acronym X, and appended to them a request such as “I want more information about X”. We expect a computer system to return in real time a set of Wikipedia pages providing the requested information, including the correct definition of the acronym (based on the meeting context) and additional information about the concept.</p> <p>The seven following acronyms were searched for in the corpus: LCD, VCR, PCB, RSI, TFT, NTSC, and IC (their correct definitions in context are given in the Appendix below). These were selected because they are related to the domain of remote controls, and the AMI Meeting Corpus contains conversations on designing remote controls.</p> <p>Based on the occurrences of these acronyms in various places of the AMI Meeting Corpus, the AREX dataset consists of 74 different conversation fragments (for which only the timing, but not the actual words are given) and the request for explanation (or query) that was created at the end. For each query, we used four different systems (described in the appendix) to retrieve potentially relevant articles from the English Wikipedia. Merging the lists of top-10 results and discarding duplicates, we found that each fragment had at least 31 different document candidates, and we decided to keep this number constant for all fragments.</p> <p>The relevance judgments were made for each list of retrieved documents by human judges recruited through the Amazon Mechanical Turk crowdsourcing platform. The relevance value of each document was assessed by showing the transcript of a conversation fragment to a human subject in a web browser, followed below it by a control question about its content, by the request for explanation, and by the list of 31 documents (Wikipedia pages). The judges had to read the conversation transcript, answer the control question, and then decide on the relevance value of each document by selecting one of the three following options: ‘irrelevant’, ‘somewhat relevant’, or ‘relevant’.</p> <p>We collected judgments over a large number of subjects and conversation fragments. The evaluation of each of the 74 conversation fragments (with 31 documents per fragment) was crowdsourced via Amazon’s Mechanical Turk as “human intelligence tasks” (HITs). For each HIT we recruited ten workers. The average time spent per HIT was around 90 seconds (hence about 3 seconds per document, to read its title and decide its relevance). For qualification control, we only accepted workers with greater than 95% approval rate and with more than 1000 previously approved HITs. We only kept answers from the workers who answered correctly our control questions about each HIT, and these answers (total per option for each fragment and query) are provided in the AREX dataset.</p> <p> </p> <p><strong>Format of AREX dataset files</strong></p> <p>Each file corresponds to a fragment of the AMI Meeting Corpus, indicated using the meeting name (AMI codes) and the timing (start and end time) included in the file name. Then, the first line indicates the acronym for which a request for explanation is made (at the end of the conversation fragment), using the following format: “Query: I want more information about X.”</p> <p>The second line consists of the timing of the conversation fragment before this query from the AMI Meeting Corpus (around 400 words) as follows: “history: [startTime-endTime]”. The actual transcript of the conversation from the AMI Corpus is not disclosed, as it requires a separate license; the AMI Corpus can be obtained from http://corpus.amiproject.org.</p> <p>The rest of each file is in tabular format, with each line corresponding to one document and each column to the total of relevance judgments, as follows (NB. the first line of the table, hence the third line of the file, is the header of the table). The four columns are:</p> <ol> <li>"irrel." – number of workers who considered "irrelevant" the document in the 4th column.</li> <li>"SW rel." –number of workers who considered the document "somewhat relevant".</li> <li>"rel." – number of workers who considered the document to be "relevant".</li> <li>"doc" – the name of the document (Wikipedia article) .</li> </ol> <p> </p> <p><strong>Evaluating a question answering system using the AREX dataset</strong></p> <p>The goal of the AREX dataset is to allow replicable evaluation of systems that are capable to answer the requests for explanations for each conversation fragment, over Wikipedia articles. By pooling a selection of retrieval systems and providing human judgments of relevance, we designed a TREC-like resource. Several metrics can be applied using the Wikipedia pages judged as ground truth (e.g. recall and precision at N). However, we propose a more nuanced metric which compares two lists of Wikipedia articles and indicates which one is “better” in terms of proximity with the human judgments.</p> <p>The Matlab code to compare two retrieval results is provided with the AREX dataset. This code compares two sets of retrieved documents obtained in two different ways. To perform comparison, the MainFile.m should be run. It requires the following information:</p> <ol> <li>"query": the address of a directory file includes files each contains the name of files corresponds to each abbreviation word</li> <li>"rootRef": the address of the directory of dataset explained above</li> <li>"rootDoc1","rootDoc2": the two directory addresses contain the name of documents retrieved for two methods aimed to be compared.</li> </ol> <p> </p> <p><strong>Appendix</strong></p> <p>Brief description of the four versions of the system. The list of assessed documents retrieved for four different types of queries over the English Wikipedia articles using the Apache Lucene search engine. The four query types used for retrieval are as follows:</p> <ol> <li>the acronym appearing in the request for explanations;</li> <li>the acronym from the request, plus keywords extracted from the conversation fragment, with equal weights;</li> <li>the acronym from the request, plus keywords extracted from the conversation fragment, weighted in proportion to their topical similarity to the acronym (using LDA over Wikipedia);</li> <li>keywords extracted from the conversation fragment, but not the acronym.</li> </ol> <p>Definitions of the seven acronyms in the senses in which they appear in the AMI Corpus Meetings (text and URL of Wikipedia page, excluding redirects or disambiguation pages):</p> <ol> <li>LCD: Liquid crystal display</li> <li>VCR: Videocassette recorder</li> <li>PCB: Printed circuit board</li> <li>RSI: Repetitive strain injury</li> <li>TFT: Thin-film transistor liquid crystal display</li> <li>NTSC: National television system committee</li> <li>IC: Integrated circuit</li> </ol>
Data from: People making deontological judgments in the Trapdoor dilemma are perceived to be more prosocial in economic games than they actually are
Why do people make deontological decisions, although they often lead to overall unfavorable outcomes? One account is receiving considerable attention: deontological judgments may signal commitment to prosociality and thus may increase people's chances of being selected as social partners–which carries obvious long-term benefits. Here we test this framework by experimentally exploring whether people making deontological judgments are expected to be more prosocial than those making consequentialist judgments and whether they are actually so. In line with previous studies, we identified deontological choices using the Trapdoor dilemma. Using economic games, we take two measures of general prosociality towards strangers: trustworthiness and altruism. Our results procure converging evidence for a perception gap according to which Trapdoor-deontologists are believed to be more trustworthy and more altruistic towards strangers than Trapdoor-consequentialists, but actually they are not so. These results show that deontological judgments are not universal, reliable signals of prosociality.
Data from: Impact of psychopathy on moral judgments about causing fear and physical harm
Psychopathy is a personality variable associated with persistent immoral behaviors. Despite this, attempts to link moral reasoning deficits to psychopathic traits have yielded mixed results with many findings supporting intact moral reasoning in individuals with psychopathic traits. Abundant evidence shows that psychopathy impairs responses to others' emotional distress. However, most studies of morality and psychopathy focus on judgments about causing others physical harm. Results of such studies may be inconsistent because physical harm is an imperfect proxy for emotional distress. No previous paradigm has explicitly separated judgments about physical harm and emotional distress and assessed how psychopathy affects each type of judgment. In three studies we found that psychopathy impairs judgments about causing others emotional distress (specifically fear) but minimally affects judgments about causing physical harm and that judgments about causing fear predict instrumental aggression in psychopathy. These findings are consistent with reports linking psychopathy to insensitivity to others' fear, and suggest that sensitivity to others' fear may play a fundamental role in the types of moral decision-making impaired by psychopathy.
The Impact of Chiropractic Activator Adjustments on Mental Rotation and Line Judgment Reaction Time
ClinicalTrials.gov study NCT02749266. IPD Sharing: Not stated. Countries: 1. Publications: 0.
Comparison on Succinylcholine Onset Time Assessed by Train of Four Stimulation Versus Clinical Judgment During Rapid Sequence Induction of Anesthesia
ClinicalTrials.gov study NCT03415607. IPD Sharing: Not stated. Countries: 1. Publications: 0.
Links Between Perception of Temporal Order Judgment and Causality in Schizophrenia
ClinicalTrials.gov study NCT03432000. IPD Sharing: NO. Countries: 1. Publications: 0.
A Multinomial Process Model of Moral Judgment
ClinicalTrials.gov study NCT02799277. IPD Sharing: NO. Countries: 1. Publications: 0.
Differential Influences of Integral and Incidental Emotion on Cancer-related Judgments and Decision Making
ClinicalTrials.gov study NCT02829554. IPD Sharing: Not stated. Countries: 1. Publications: 0.
Development and Effectiveness Verification of an AI Application for Pressure Injury Nursing Based on Clinical Judgment Model
ClinicalTrials.gov study NCT07132320. IPD Sharing: NO. Countries: 1. Publications: 0.
The Effect of Simulation-based Education Within the Framework of the Clinical Judgment Model on Nursing Students' Clinical Decision-making Skills and Perceptions of Nursing Process Competence.
ClinicalTrials.gov study NCT07297498. IPD Sharing: NO. Countries: 1. Publications: 0.
A Team-based Approach to Improve Knowledge and Judgment Performance in Electronic Fetal Monitoring
ClinicalTrials.gov study NCT04040257. IPD Sharing: NO. Countries: 1. Publications: 0.
Fear of Other's Judgment, Self-esteem and Use of Social Networks Among Students
ClinicalTrials.gov study NCT06268756. IPD Sharing: UNDECIDED. Countries: 1. Publications: 0.
How Clinical and Personal Information Shape Physicians' Risk Judgments
ClinicalTrials.gov study NCT07162376. IPD Sharing: YES. Countries: 1. Publications: 0.
Data from: Impact of psychopathy on moral judgments about causing fear and physical harm
Open the record for dataset details and reuse information.
Data from: People making deontological judgments in the Trapdoor dilemma are perceived to be more prosocial in economic games than they actually are
Open the record for dataset details and reuse information.
Perceptual judgments of parabolic trajectories
<p>Dataset for the article: "Perceptual judgments of duration of parabolic motions"</p>
Physician Judgment and Machine Predictions
ClinicalTrials.gov study NCT02694159. IPD Sharing: NO. Countries: 0. Publications: 0.
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.