Association of Online Consumer Reviews of Skilled Nursing Facilities With Patient Rehospitalization Rates
Authors: Kira L. Ryskina, Anietie U. Andy, Kirstin A. Manges, Kierra A. Foley, Rachel M. Werner, Raina M. Merchant
Journal: JAMA Network Open (2020)

<h3>Importance</h3> There are areas of skilled nursing facility (SNF) experience of importance to the public that are not currently included in public reporting initiatives on SNF quality. Whether patients, hospitals, and payers can leverage the information available from unsolicited online reviews to reduce avoidable rehospitalizations from SNFs is unknown. <h3>Objectives</h3> To assess the association between rehospitalization rates and online ratings of SNFs; to compare the association of rehospitalization with ratings from a review website vs Medicare Nursing Home Compare (NHC) ratings; and to identify specific topics consistently reported in reviews of SNFs with the highest vs lowest rehospitalization rates using natural language processing. <h3>Design, Setting, and Participants</h3> A retrospective cross-sectional study of 1536 SNFs with online reviews on Yelp (a website that allows consumers to rate and review businesses and services, scored on a 1- to 5-star rating scale, with 1 star indicating the lowest rating and 5 stars indicating the highest rating) posted between January 1, 2014, and December 31, 2018. The combined data set included 1536 SNFs with 8548 online reviews, NHC ratings, and readmission rates. <h3>Main Outcomes and Measures</h3> A mean rating from the review website was calculated through the end of each year. Risk-standardized rehospitalization rates were obtained from NHC. Linear regression was used to measure the association between the rehospitalization rate of a SNF and the online ratings. Natural language processing was used to identify topics associated with reviews of SNFs in the top and bottom quintiles of rehospitalization rates. <h3>Results</h3> The 1536 SNFs in the sample had a median of 6 reviews (interquartile range, 3-13 reviews), with a mean (SD) review website rating of 2.7 (1.1). The SNFs with the highest rating on both the review website and NHC had 2.0% lower rehospitalization rates compared with the SNFs with the lowest rating on both websites (21.3%; 95% CI, 20.7%-21.8%; vs 23.3%; 95% CI, 22.7%-24.0%;<i>P</i> = .04). Compared with the NHC ratings alone, review website ratings were associated with an additional 0.4% of the variation in rehospitalization rates across SNFs (adjusted<i>R</i><sup>2</sup> = 0.009 vs adjusted<i>R</i><sup>2</sup> = 0.013;<i>P</i> = .003). Thematic analysis of qualitative comments on the review website for SNFs with high vs low rehospitalization rates identified several areas of importance to the reviewers, such as the quality of physical infrastructure and equipment, staff attitudes and communication with caregivers. <h3>Conclusions and Relevance</h3> Skilled nursing facilities with the best rating on both a review website and NHC had slightly lower rehospitalization rates than SNFs with the best rating on NHC alone. However, there was marked variation in the volume of reviews, and many SNF characteristics were underrepresented. Further refinement of the review process is warranted.