Task: Sentence Composition
Input (English): Given that this is an illegal substance banned by the U.S. Drug Enforcement Agency, cost as a therapeutic would be difficult to ascertain. We liked that the story took pains to explain that approval of this drug faces many hurdles. This is a tough one. While the story tells us what percentage of patients benefited from treatment, it does not, in fact, quantify the extent of those benefits–which is precisely what this category is designed to assess. However, the story does do a good–and thorough–job of describing the benefits in qualitative terms. That said, if the story had only chosen one or two examples of changes in the standardized measures of depression or anxiety, this would have received an enthusiastic “Satisfactory” rating. One strong word of caution though: The story cites one source as saying that psilocybin may one day be used to treat a wide range of mental health issues ranging from drug addiction to obsessive-compulsive disorder. The story offers no evidence to support these claims, which were made by a source associated with an organization that exists specifically to promote research on hallucinogens. Substantial claims require substantial evidence. The story would have been much stronger if it had eliminated the unsubstantiated remarks from the source — particularly since they had no bearing on the subject of the story. The story addresses this issue thoroughly. Well done. The story does a good job of both describing the design of the studies and explaining why the study design is relevant. For example, the story notes: “But both [studies] were considered to be double-blind placebo trials — the gold-standard of medical research in which subjects are left to guess whether they have gotten the active study drug or an inactive lookalike.” This is the sort of thing we like to see. However, we did want to note that in the NYU study, researchers did state in the limitations section that there was “limited blinding” — how did that possibly affect the outcomes? No disease mongering here. However, the story should have been more cautious about claims of benefit for conditions ranging far beyond the scope of the research at hand, which focused on mental health problems among people with advanced cancer. The story clearly states who funded the studies, and what that organization’s long-term goals are. Further, the story clearly identified individuals quoted in the story who have ties to the studies or the funding organization. Lastly, the story incorporates input from an independent expert. However, the story would have been stronger if there had been a skeptical take on the research, which saw in some other coverage, such as this New York Times piece. The story does not address other treatment options for anxiety or depression, such as talk therapy or other pharmaceutical interventions. The story does a good job here. For example, the story notes: “[F]inding drugs like psilocybin effective is by no means the final hurdle to their widespread availability. None are currently in production, and no for-profit pharmaceutical company would likely invest millions of dollars to bring to market a pill intended effectively for one-time use.” Well done. This is a close call. The story does do a good job of placing the work in context in regard to overall research involving hallucinogens. That’s enough to earn it a “Satisfactory” rating. However, the story doesn’t mention any of the work done in the past 10 years on the use of psilocybin specifically to address anxiety in cancer patients, such as this 2007 study, this one from 2011, or this one from 2013. Are the results from the two new studies consistent with these earlier findings? Do they differ in a meaningful way? That would be good to know. The story does not appear to rely on a news release.
Output (English): Ingredient in magic mushrooms is shown to ease anxiety and depression in cancer patients in one dose