Evaluation of the Quality, Accuracy, and Readability of Online Patient Resources for the Management of Articular Cartilage Defects

Patients commonly use the Internet to obtain their health-related information. The purpose of this study was to investigate the quality, accuracy, and readability of online patient resources for the management of articular cartilage defects.  Three search terms (“cartilage defect,” “cartilage damage,” “cartilage injury”) were entered into 3 Internet search engines (Google, Bing, Yahoo). The first 25 websites from each search were collected and reviewed. The quality and accuracy of online information were independently evaluated by 3 reviewers using predetermined scoring criteria. The readability was evaluated using the Flesch-Kincaid (FK) grade score.  Fifty-three unique websites were evaluated. Quality ratings were significantly higher in websites with a FK score >11 compared to those with a score of ≤11 (P = 0.021). Only 10 websites (19%) differentiated between focal cartilage defects and diffuse osteoarthritis. Of these, 7 (70%) were elicited using the search term “cartilage defect” (P = 0.038). The average accuracy of the websites was high (11.7 out of maximum 12), and the average FK grade level (13.4) was several grades higher than the recommended level for readable patient education material (eighth grade level).  The quality and readability of online patient resources for articular cartilage defects favor those with a higher level of education. Additionally, the majority of these websites do not distinguish between focal chondral defects and diffuse osteoarthritis, which can fail to provide appropriate patient education and guidance for available treatment. Clinicians should help guide patients toward high-quality, accurate, and readable online patient education material.

Related papers:

title: Assessing Readability of Patient Education Materials: Current Role in Orthopaedics
abstract: BackgroundHealth literacy is the single best predictor of an individual’s health status. It is important to customize health-related education material to the individual patient’s level of reading skills. Readability of a given text is the objective measurement of the reading skills one should possess to understand the written material. this article, some of the commonly used readability assessment tools are discussed and guidelines to improve the comprehension of patient education handouts are provided.Where are we now? Several healthcare organizations have recommended the readability of patient education materials be no higher than sixth- to eighth-grade level. However, most of the patient education materials currently available on major orthopaedic Web sites are written at a reading level that may be too advanced for comprehension by a substantial proportion of the population.Where do we need to go?There are several readily available and validated tools for assessing the readability of written materials. While use of audiovisual aids such as video clips, line drawings, models, and charts can enhance the comprehension of a health-related topic, standard readability tools cannot construe such enhancements.How do we get there?Given the variability in the capacity to comprehend health-related materials among individuals seeking orthopaedic care, stratifying the contents of patient education materials at different levels of complexity will likely improve health literacy and enhance patient-centered communication.

title: The relationship of patient reading ability to self-reported health and use of health services.
abstract: This study examined the relationship of functional health literacy to self-reported health and use of health services.



Patients presenting to two large, urban public hospitals in Atlanta, Ga, and Torrance, Calif, were administered a health literacy test about their overall health and use of health care services during the 3 months preceding their visit.



Patients with inadequate functional health literacy were more likely than patients with adequate literacy to report their health as poor. Number of years of school completed was less strongly associated with self-reported health. Literacy was not related to regular source of care or physician visits, but patients in Atlanta with inadequate literacy were more likely than patients with adequate literacy to report a hospitalization in the previous year.



Low literacy is strongly associated with self-reported poor health and is more closely associated with self-reported health than number of years of school completed.

title: How Long Does It Take to Assess Literacy Skills in Clinical Practice?
abstract: Health literacy screening is often not performed in clinical settings. One possible reason is the concern about the time involved in performing such assessments. Our objective was to measure the time required to administer the Newest Vital Sign (NVS) literacy assessment instrument to English-speaking primary care patients.  The NVS was administered to 78 consecutive English-speaking patients in an outpatient primary care clinic. The length of time to complete the NVS was timed with a stopwatch.  The average time to complete the NVS was 2.9 minutes (95% confidence limit, 2.6–3.1 min).  The NVS is a health literacy screening tool of sufficient brevity to be considered for use in primary care practices.

title: Online resources for shoulder instability: what are patients reading?
abstract: Evaluations of the medical literature suggest that many online sites provide poor-quality information. The purpose of our study was to investigate the value of online resources for patient education about shoulder instability.



Three search terms ("shoulder instability," "loose shoulder," and "shoulder dislocation") were entered into three Internet search engines. Three orthopaedic residents independently gauged the quality and accuracy of the information with use of a set of predetermined scoring criteria, in addition to noting whether or not four potential surgery options were mentioned. The readability of the web sites was evaluated with use of the Flesch-Kincaid score.



Eighty-two unique web sites were evaluated. Quality and accuracy were significantly higher with use of the term "shoulder instability" compared with the term "loose shoulder" (quality, p < 0.001; accuracy, p = 0.001). However, the reading level was significantly more advanced for the "shoulder instability" web sites (p < 0.001). Quality was significantly higher on web sites with reading levels above the eighth grade level (p = 0.001) (88% of web sites). Only twenty-three sites (28%) mentioned surgical options for shoulder instability, and of these, only eight mentioned thermal capsulorrhaphy as a primary treatment.



Online information regarding shoulder instability is often inaccurate and/or at an inappropriately high reading level. The quality of information is highly dependent on the specific search term used. Clinicians need to be aware of the information that is available online and should help direct patients to proper sites and guide Internet search terms.

title: Readability of Orthopaedic Oncology-related Patient Education Materials Available on the Internet
abstract: A person's health literacy is one of the most important indicators of a patient’s health status. According to national recommendations, patient education materials should be written at no higher than the sixth- to eighth-grade reading level. The purpose of our study was to assess the readability of online patient education materials related to orthopaedic oncology on the websites of the American Academy of Orthopaedic Surgeons (AAOS), American Cancer Society (ACS), Bone and Cancer Foundation (BCF), and National Cancer Institute ( We searched the online patient education libraries of the AAOS, ACS, BCF, and NCI for all articles related to orthopaedic oncology. The Flesch-Kincaid (FK) readability score was calculated for each article and compared between sources. A total of 227 articles were identified with an overall mean FK grade level of 9.8. Stratified by source, the mean FK grade levels were 10.1, 9.6, 11.1, and 9.5 for the AAOS, ACS, BCF, and NCI, respectively (P < 0.003). Only 31 articles (14%) and 1 article (0.4%) were at or below the recommended eighth- and sixth-grade levels, respectively. Online patient education materials related to orthopaedic oncology appear to be written at a level above the comprehension ability of the average patient.

title: Evaluating the Quality, Accuracy, and Readability of Online Resources Pertaining to Hallux Valgus
abstract: The Internet is one of the most widely utilized resources for health-related information. Evaluation of the medical literature suggests that the quality and accuracy of these resources are poor and written at inappropriately high reading levels. The purpose of our study was to evaluate the quality, accuracy, and readability of online resources pertaining to hallux valgus.  Two search terms (“hallux valgus” and “bunion”) were entered into Google, Yahoo, and Bing. With the use of scoring criteria specific to hallux valgus, the quality and accuracy of online information related to hallux valgus was evaluated by 3 reviewers. The Flesch–Kincaid score was used to determine readability. Statistical analysis was performed with t tests and significance was determined by P values <.05.  Sixty-two unique websites were evaluated. Quality was significantly higher with use of the search term “bunion” as compared to “hallux valgus” (P = .045). Quality and accuracy were significantly higher in resources authored by physicians as compared to nonphysicians (quality, P = .04; accuracy, P < .001) and websites without commercial bias (quality, P = .038; accuracy, P = .011). However, the reading level was significantly more advanced for websites authored by physicians (P = .035). Websites written above an eighth-grade reading level were significantly more accurate than those written at or below an eighth-grade reading level (P = .032).  The overall quality of online information related to hallux valgus is poor and written at inappropriate reading levels. Furthermore, the search term used, authorship, and presence of commercial bias influence the value of these materials. It is important for orthopaedic surgeons to become familiar with patient education materials, so that appropriate recommendations can be made regarding valuable resources.

title: Cartilage injuries: a review of 31,516 knee arthroscopies.
abstract: Although articular cartilage injuries of the knee are common, injured cartilage has a limited ability to heal. Recent data suggest that articular cartilage grafting may provide treatment for these injuries. To define the patient population that might benefit from cartilage grafting, 31,516 knee arthroscopies were reviewed. Between June 1991 and October 1995, 53,569 hyaline cartilage lesions were documented in 19,827 patients. The majority were articular cartilage lesions; grade III lesions of the patella were the most common. Grade IV lesions were predominantly located on the medial femoral condyle. Patients under 40 years of age with grade IV lesions accounted for 5% of all arthroscopies; 74% of these patients had a single chondral lesions (4% of the arthroscopies). No associated ligamentous or meniscal pathology was found in 36.6% of these patients.

title: Articular cartilage defects in 1,000 knee arthroscopies.
abstract: Focal chondral or osteochondral defects can be painful and disabling, have a poor capacity for repair, and may predispose patients for osteoarthritis. New surgical procedures that aim to reestablish hyaline cartilage have been introduced and the results seem promising. The purpose of this study is to provide reliable data on chondral and osteochondral defects in patients with symptomatic knees requiring arthroscopy and to calculate the prevalence of patients who might benefit from cartilage repair surgery.



Prospective study.



One thousand consecutive knee arthroscopies were included in this study. Immediately after each arthroscopy, the surgeon completed a questionnaire providing detailed information about the findings. Chondral and osteochondral lesions were classified in accordance with the system recommended by the International Cartilage Repair Society (ICRS).



Chondral or osteochondral lesions (of any type) were found in 61% of the patients. Focal chondral or osteochondral defects were found in 19% of the patients. In these patients, 61% related their current knee problem to a previous trauma, and a concomitant meniscal or anterior cruciate ligament injury was found in 42% (n = 81) and 26% (n = 50), respectively. The mean chondral or osteochondral total defect area was 2.1 cm(2) (range, 0.5 to 12; standard deviation [SD], 1.5). The main focal chondral or osteochondral defect was found on the medial femoral condyle in 58%, patella in 11%, lateral tibia in 11%, lateral femoral condyle in 9%, trochlea in 6%, and medial tibia in 5%. It has been suggested that cartilage repair surgery may be most suitable in patients younger than 40 to 50 years old. A single, well-defined ICRS grade III or IV defect with an area of at least 1 cm(2) in a patient younger than 40, 45, or 50 years accounted for 5.3%, 6.1%, and 7.1% of all arthroscopies, respectively.



Our study supports the contention that articular cartilage defects are common. It has the advantages of a prospective design and use of a new classification system recommended by the ICRS. This modern system focuses on objectively measurable parameters of the lesion's extent and not its surface appearance.

title: Prevalence of chondral defects in athletes' knees: a systematic review.
abstract: To determine the prevalence of full-thickness focal chondral defects in the athlete's knee.



We conducted a systematic review of multiple databases, evaluating studies of the prevalence of articular cartilage defects in athletes. Because of the heterogeneity of data, a meta-analysis could not be performed.



Eleven studies were identified for inclusion (931 subjects). All studies were level 4 evidence. Defects were diagnosed via magnetic resonance imaging, arthroscopy, or both. Forty percent of athletes were professionals (NBA and NFL). The overall prevalence of full-thickness focal chondral defects in athletes was 36% (range = 2.4%-75% between all studies). Fourteen percent of athletes were asymptomatic at the time of diagnosis. Patellofemoral defects (37%) were more common than femoral condyle (35%) and tibial plateau defects (25%). Medial condyle defects were more common than lateral (68% vs 32%), and patella defects were more common than trochlea (64% vs 36%). Meniscal tear (47%) was the most common concomitant knee pathological finding, followed by anterior cruciate ligament tear (30%) and then medial collateral ligament or lateral collateral ligament tear (14%).



Full-thickness focal chondral defects in the knee are more common in athletes than among the general population. More than one-half of asymptomatic athletes have a full-thickness defect. Further study is needed to define more precisely the prevalence of these lesions in this population.

title: Trends in the surgical treatment of articular cartilage lesions in the United States: an analysis of a large private-payer database over a period of 8 years.
abstract: The purpose of this study was to quantify the current trends in knee cartilage surgical techniques performed in the United States from 2004 through 2011 using a large private-payer database. A secondary objective was to identify salient demographic factors associated with these procedures.



We performed a retrospective database review using a large private-payer medical record database within the PearlDiver database. The PearlDiver database is a publicly available, Health Insurance Portability and Accountability Act-compliant national database compiled from a collection of private insurer records. A search was performed for surgical techniques in cartilage palliation (chondroplasty), repair (microfracture/drilling), and restoration (arthroscopic osteochondral autograft, arthroscopic osteochondral allograft, autologous chondrocyte implantation, open osteochondral allograft, and open osteochondral autograft). The incidence, growth, and demographic factors associated with the surgical procedures were assessed.



From 2004 through 2011, 198,876,000 patients were analyzed. A surgical procedure addressing a cartilage defect was performed in 1,959,007 patients, for a mean annual incidence of 90 surgeries per 10,000 patients. Across all cartilage procedures, there was a 5.0% annual incidence growth (palliative, 3.7%; repair, 0%; and restorative, 3.1%) (P = .027). Palliative techniques (chondroplasty) were more common (>2:1 ratio for repair [marrow-stimulation techniques] and 50:1 ratio for restoration [autologous chondrocyte implantation and osteochondral autograft and allograft]). Palliative surgical approaches were the most common technique, regardless of age, sex, or region.



Articular cartilage surgical procedures in the knee are common in the United States, with an annual incidence growth of 5%. Surgical techniques aimed at palliation are more common than cartilage repair and restoration techniques regardless of age, sex, or region.

title: Novel scaffold-based BST-CarGel treatment results in superior cartilage repair compared with microfracture in a randomized controlled trial.
abstract: Microfracture, the standard of care, is recognized to be an incomplete solution for cartilage damage. BST-CarGel, a chitosan-based medical device, is mixed with autologous whole blood and is applied to a microfractured cartilage lesion in which it physically stabilizes the clot and guides and enhances marrow-derived repair. An international, multicenter, randomized controlled trial was conducted to evaluate BST-CarGel treatment compared with microfracture alone in the repair of cartilage lesions in the knee.



Eighty patients between the ages of eighteen and fifty-five years with a single, symptomatic focal lesion on the femoral condyles were randomized to BST-CarGel and microfracture treatment (n = 41) or microfracture treatment alone (n = 39). The primary end points of repair tissue quantity and quality at twelve months were assessed by quantitative three-dimensional magnetic resonance imaging measuring the degree of lesion filling and T2 relaxation time with use of standardized one and twelve-month posttreatment scans. The secondary end point at twelve months was clinical benefit determined with the Western Ontario and McMaster Universities Osteoarthritis Index. The tertiary end point was quality of life determined by the Short Form-36. Safety was assessed through the recording of adverse events.



Patient baseline characteristics were similar in the two groups, although baseline lesion areas were slightly larger on quantitative magnetic resonance imaging for the BST-CarGel group compared with the microfracture group. Blinded quantitative magnetic resonance imaging analysis demonstrated that, at twelve months, when compared with microfracture treatment alone, BST-CarGel treatment met both primary end points by achieving statistical superiority for greater lesion filling (p = 0.011) and more hyaline cartilage-like T2 values (p = 0.033). The lesion filling values were 92.8% ± 2.0% for the BST-CarGel treatment group and 85.2% ± 2.1% for the microfracture treatment group, and the mean T2 values were 70.5 ± 4.5 ms for the BST-CarGel treatment group and 85.0 ± 4.9 ms for the microfracture treatment group. Western Ontario and McMaster Universities Osteoarthritis Index subscales for pain, stiffness, and function yielded equivalent improvement for both groups at twelve months, which were significant (p < 0.0001) from baseline. Treatment safety profiles were considered comparable.



At twelve months, BST-CarGel treatment resulted in greater lesion filling and superior repair tissue quality compared with microfracture treatment alone. Clinical benefit was equivalent between groups at twelve months, and safety was similar.

title: Management of articular cartilage defects of the knee.
abstract: Articular cartilage has a poor intrinsic capacity for healing. The goal of surgical techniques to repair articular cartilage injuries is to achieve the regeneration of organized hyaline cartilage. Microfracture and other bone marrow stimulation techniques involve penetration of the subchondral plate in order to recruit mesenchymal stem cells into the chondral defect. The formation of a stable clot that fills the lesion is of paramount importance to achieve a successful outcome. Mosaicplasty is a viable option with which to address osteochondral lesions of the knee and offers the advantage of transplanting hyaline cartilage. However, limited graft availability and donor site morbidity are concerns. Transplantation of an osteochondral allograft consisting of intact, viable articular cartilage and its underlying subchondral bone offers the ability to address large osteochondral defects of the knee, including those involving an entire compartment. The primary theoretical advantage of autologous chondrocyte implantation is the development of hyaline-like cartilage rather than fibrocartilage in the defect, which presumably leads to better long-term outcomes and longevity of the healing tissue. Use of synthetic scaffolds is a potentially attractive alternative to traditional cartilage procedures as they are readily available and, unlike allogeneic tissue transplants, are associated with no risk of disease transmission. Their efficacy, however, has not been proven clinically.

title: Current perspectives in stem cell research for knee cartilage repair
abstract: Protocols based on the delivery of stem cells are currently applied in patients, showing encouraging results for the treatment of articular cartilage lesions (focal defects, osteoarthritis). Yet, restoration of a fully functional cartilage surface (native structural organization and mechanical functions) especially in the knee joint has not been reported to date, showing the need for improved designs of clinical trials. Various sources of progenitor cells are now available, originating from adult tissues but also from embryonic or reprogrammed tissues, most of which have already been evaluated for their chondrogenic potential in culture and for their reparative properties in vivo upon implantation in relevant animal models of cartilage lesions. Nevertheless, particular attention will be needed regarding their safe clinical use and their potential to form a cartilaginous repair tissue of proper quality and functionality in the patient. Possible improvements may reside in the use of biological supplements in accordance with regulations, while some challenges remain in establishing standardized, effective procedures in the clinics.

title: EVALUATION OF LITERACY LEVEL OF PATIENT EDUCATION PAGES 
IN HEALTH-RELATED JOURNALS

abstract: The purpose of this study was to evaluate the reading level of patient education material from selected current health care journals. Ten patient education pages from a variety of health care journals were entered into a Microsoft Word program. Applying the Flesch–Kincaid readability formula available from Microsoft Word, a reading level for each page was established and compared to recommended standards. Only 2 of 10 patient education pages fell within the recommended reading levels for health-related materials, and 5 of 10 were above the estimated mean U.S. reading level of 8th grade. A 5th to 6th grade level is recommended for patient education materials. This study suggests that although it is known that low health literacy is a widespread problem, it is not always considered when patient-targeted materials are developed. Health care professionals need to become more active in addressing the literacy needs of the intended receiver of written health-related information.

title: Does the quality, accuracy, and readability of information about lateral epicondylitis on the internet vary with the search term used?
abstract: BackgroundConcern exists over the quality, accuracy, and accessibility of online information about health care conditions. The goal of this study is to evaluate the quality, accuracy, and readability of information available on the internet about lateral epicondylitis.MethodsWe used three different search terms (“tennis elbow,” “lateral epicondylitis,” and “elbow pain”) in three search engines (Google, Bing, and Yahoo) to generate a list of 75 unique websites. Three orthopedic surgeons reviewed the content of each website and assessed the quality and accuracy of information. We assessed each website’s readability using the Flesch–Kincaid method. Statistical comparisons were made using ANOVA with post hoc pairwise comparisons.ResultsThe mean reading grade level was 11.1. None of the sites were under the recommended sixth grade reading level for the general public. Higher quality information was found when using the terms “tennis elbow” and “lateral epicondylitis” compared to “elbow pain” (p < 0.001). Specialty society websites had higher quality than all other websites (p < 0.001). The information was more accurate if the website was authored by a health care provider when compared to non-health care providers (p = 0.003). Websites seeking commercial gain and those found after the first five search results had lower quality information.ConclusionsReliable information about lateral epicondylitis is available online, especially from specialty societies. However, the quality and accuracy of information vary significantly with the search term, website author, and order of search results. This leaves less educated patients at a disadvantage, particularly because the information we encountered is above the reading level recommended for the general public.

title: Surfing for Scoliosis: The Quality of Information Available on the Internet
abstract: A cross section of Web sites accessible to the general public was surveyed.  To evaluate the quality and accuracy of information on scoliosis that a patient might access on the Internet.  The Internet is a rapidly expanding communications network with an estimated 765 million users worldwide by the year 2005. Medical information is one of the most common sources of inquires on the Web. More than 100 million Americans accessed the Internet for medical information in the year 2000. Undoubtedly, the use of the Internet for patient information needs will continue to expand as Internet access becomes more readily available. This expansion combined with the Internet’s poorly regulated format can lead to problems in the quality of information available. Since the Internet operates on a global scale, implementing and enforcing standards have been difficult. The largely uncontrolled information can potentially negatively influence consumer health outcomes.  To identify potential sites, five search engines were selected and the word “scoliosis” was entered into each search engine. A total of 50 Web sites were chosen for review. Each Web site was evaluated according to the type of Web site, quality content, and informational accuracy by three board-certified academic orthopedic surgeons, fellowship trained in spinal surgery, who each has been in practice for a minimum of 8 years. Each Web site was categorized as academic, commercial, physician, nonphysician health professional, and unidentified. In addition, each Web site was evaluated according to scoliosis-specific content using a point value system of 32 disease-specific key words pertinent to the care of scoliosis on an ordinal scale. A list of these words is given. Point values were given for the use of key words related to disease summary, classifications, treatment options, and complications. The accuracy of the individual Web site was evaluated by each spine surgeon using a scale of 1 to 4. A score of 1 represents that the examiner agreed with less than 25% of the information while a score of 4 represents greater than 75% agreement.  Of the total 50 Web sites evaluated, 44% were academic, 18% were physician based, 16% were commercial, 12% were unidentified, and 10% were nonphysician health professionals. The quality content score (maximum, 32 points) for academic sites was 12.6 ± 3.8, physician sites 11.3 ± 4.0, commercial sites 11 ± 4.2, unidentified 7.6 ± 3.9, and nonphysician health professional site 7.0 ± 1.8. The accuracy score (maximum, 12 points) was 6.6 ± 2.4 for academic sites, 6.3 ± 3.0 for physician-professional sites, 6.0 ± 2.7 for unidentified sites, 5.5 ± 3.8 for nonphysician professional sites, and 5.0 ± 1.5 for commercial Web sites. The academic Web sites had the highest mean scores in both quality and accuracy content scores.  The information about scoliosis on the Internet is of limited quality and poor information value. Although the majority of the Web sites were academic, the content quality and accuracy scores were still poor. The lowest scoring Web sites were the nonphysician professionals and the unidentified sites, which were often message boards. Overall, the highest scoring Web site related to both quality and accuracy of information was www.srs.org. This Web site was designed by the Scoliosis Research Society. The public and the medical communities need to be aware of these existing limitations of the Internet. Based on our review, the physician must assume primary responsibility of educating and counseling their patients.

title: Readability of Online Patient Education Materials From the AAOS Web Site
abstract: One of the goals of the American Academy of Orthopaedic Surgeons (AAOS) is to disseminate patient education materials that suit the readability skills of the patient population. According to standard guidelines from healthcare organizations, the readability of patient education materials should be no higher than the sixth-grade level. We hypothesized the readability level of patient education materials available on the AAOS Web site would be higher than the recommended grade level, regardless when the material was available online. Readability scores of all articles from the AAOS Internet-based patient information Web site, “Your Orthopaedic Connection,” were determined using the Flesch-Kincaid grade formula. The mean Flesch-Kincaid grade level of the 426 unique articles was 10.43. Only 10 (2%) of the articles had the recommended readability level of sixth grade or lower. The readability of the articles did not change with time. Our findings suggest the majority of the patient education materials available on the AAOS Web site had readability scores that may be too difficult for comprehension by a substantial portion of the patient population.

title: Readability and comprehensibility of patient education material in hand-related web sites.
abstract: As patients are more frequently referring to the Internet for information on their musculoskeletal problems, the readability and comprehensibility of these educational materials becomes increasingly more important to most of the lay public. In this study, we investigated the readability of the currently available web sites of the American Society for Surgery of the Hand (ASSH) and the American Academy of Orthopaedic Surgeons (AAOS) that pertain to hand and wrist problems, to assess their usefulness as a source for patient information.



We analyzed all articles available in 2008 from the AAOS web site within the Patient Education Library under the heading, "Hand & Wrist" and from the ASSH web site under the heading, "Hand Conditions." A total of 83 articles were identified for hand conditions. Each article was analyzed by the Flesch-Kincaid program available in Microsoft Office Word software and the Dale-Chall grade-level assessor. These program models analyze all words in the specified text and return a grade level that corresponds to the difficulty level of the text.



The AAOS web sites contained 34 articles with a mean Flesch-Kincaid grade level of 8.5 and a mean Dale-Chall grade level of 8.8. The ASSH web site contained 49 articles showing a mean Flesch-Kincaid grade level of 10.4 and a mean Dale-Chall grade level of 10.8.



Our results suggest that the patient education materials found on the AAOS and ASSH web sites have readability scores that are higher than the recommended reading levels and thus may be too difficult to be understood by a substantial portion of the U.S. population.

title: The effect of search term on the quality and accuracy of online information regarding distal radius fractures.
abstract: Recent emphasis on shared decision making and patient-centered research has increased the importance of patient education and health literacy. The internet is rapidly growing as a source of self-education for patients. However, concern exists over the quality, accuracy, and readability of the information. Our objective was to determine whether the quality, accuracy, and readability of information online about distal radius fractures vary with the search term.



This was a prospective evaluation of 3 search engines using 3 different search terms of varying sophistication ("distal radius fracture," "wrist fracture," and "broken wrist"). We evaluated 70 unique Web sites for quality, accuracy, and readability. We used comparative statistics to determine whether the search term affected the quality, accuracy, and readability of the Web sites found. Three orthopedic surgeons independently gauged quality and accuracy of information using a set of predetermined scoring criteria. We evaluated the readability of the Web site using the Fleisch-Kincaid score for reading grade level.



There were significant differences in the quality, accuracy, and readability of information found, depending on the search term. We found higher quality and accuracy resulted from the search term "distal radius fracture," particularly compared with Web sites resulting from the term "broken wrist." The reading level was higher than recommended in 65 of the 70 Web sites and was significantly higher when searching with "distal radius fracture" than "wrist fracture" or "broken wrist." There was no correlation between Web site reading level and quality or accuracy.



The readability of information about distal radius fractures in most Web sites was higher than the recommended reading level for the general public. The quality and accuracy of the information found significantly varied with the sophistication of the search term used.



Physicians, professional societies, and search engines should consider efforts to improve internet access to high-quality information at an understandable level.

title: Internet Search Term Affects the Quality and Accuracy of Online Information About Developmental Hip Dysplasia
abstract: The recent emphasis on shared decision-making has increased the role of the Internet as a readily accessible medical reference source for patients and families. However, the lack of professional review creates concern over the quality, accuracy, and readability of medical information available to patients on the Internet.  Three Internet search engines (Google, Yahoo, and Bing) were evaluated prospectively using 3 difference search terms of varying sophistication (“congenital hip dislocation,” “developmental dysplasia of the hip,” and “hip dysplasia in children”). Sixty-three unique Web sites were evaluated by each of 3 surgeons (2 fellowship-trained pediatric orthopaedic attendings and 1 orthopaedic chief resident) for quality and accuracy using a set of scoring criteria based on the AAOS/POSNA patient education Web site. The readability (literacy grade level) of each Web site was assessed using the Fleisch-Kincaid score.  There were significant differences noted in quality, accuracy, and readability of information depending on the search term used. The search term “developmental dysplasia of the hip” provided higher quality and accuracy compared with the search term “congenital hip dislocation.” Of the 63 total Web sites, 1 (1.6%) was below the sixth grade reading level recommended by the NIH for health education materials and 8 (12.7%) Web sites were below the average American reading level (eighth grade).  The quality and accuracy of information available on the Internet regarding developmental hip dysplasia significantly varied with the search term used. Patients seeking information about DDH on the Internet may not understand the materials found because nearly all of the Web sites are written at a level above that recommended for publically distributed health information.  Physicians should advise their patients to search for information using the term “developmental dysplasia of the hip” or, better yet, should refer patients to Web sites that they have personally reviewed for content and clarity. Orthopaedic surgeons, professional societies, and search engines should undertake efforts to ensure that patients have access to information about DDH that is both accurate and easily understandable.

title: Factors affecting progression of knee cartilage defects in normal subjects over 2 years.
abstract: Cartilage defects are present in subjects with knee osteoarthritis (OA). Although they are often present in healthy subjects, there is little data on the natural history of cartilage defects. The aim of this study was to examine the change in cartilage defects over 2 yr and to identify factors associated with this change.



One hundred and twenty-four healthy subjects underwent magnetic resonance imaging of their dominant knee at baseline and follow-up. Cartilage defects were scored (0-4) at five sites. Bone size was determined at medial and lateral tibial plateau and patella. Height, weight, body mass index and physical activity were measured by standard protocols.



Eighty-six subjects completed the study. The mean cartilage defect score of each tibiofemoral compartment increased over time. However, medial and lateral tibiofemoral defect score decreased in 5% of the subjects. Cartilage defects were more likely to progress in males than females in each individual compartment (P<0.001 for medial tibiofemoral, P=0.005 for lateral tibiofemoral and P=0.01 for patellar cartilage). Baseline cartilage defect score was negatively associated with the progression of cartilage defects in each compartment (all P<0.001).



Although knee cartilage defects progressed over time in the majority of normal subjects, those of the highest severity tended to regress. Male gender and baseline cartilage defect score were the main factors associated with the progression of cartilage defects. Larger studies will be required to identify factors associated with the progression and regression of lesions.

title: Readability of the Patient Education Section of the AOFAS Website
abstract: One of the goals of the AOFAS website is to provide easily understandable information about orthopaedic foot and ankle conditions to the public. However, validation of this goal has not been conducted. Evaluation of text reading level is frequently performed using the Flesch-Kincaid formula (FKF). This study evaluated whether the patient information section of the AOFAS website meets recommended readability guidelines for medical information.  Seventy-nine publicly accessible entries within the patient education section of the AOFAS website were analyzed for grade level readability using the FKF.  Two entries were unable to be effectively evaluated using the FKF. The average grade reading level of all patient education entries was 8.3 (95% CI 7.8 to 8.9). Only 20.8% of entries were at or below a 6th grade reading level. Almost 30% were above the 8th grade level. The average grade levels of the constituent sections were: “Ailments and Conditions”, 8.7; “Steps to Recovery”, 7.1; “Adult Feet”, 8.3; “Children's Feet”, 7.5; “Foot Health and Fitness”, 7.8; “Shoes”, 8.5; and “Glossary”, 10.1. The percentage of entries within these sections below a 7th grade reading level were 13%, 30%, 0%, 0%, 43%, 24% and 0%, respectively.  The percentage of entries at or below the recommended 6th grade reading level on the AOFAS website compared favorably with other orthopaedic organizations' websites. However, the majority still exceeds a recommended reading level. To enhance the readability of patient education materials, we believe use of computer aided readability assessment tools should be considered in future website revisions.

title: Readability of Spine-Related Patient Education Materials From Subspecialty Organization and Spine Practitioner Websites
abstract: Analysis of spine-related websites available to the general public.  To assess the readability of spine-related patient educational materials available on professional society and individual surgeon or practice based websites.  The Internet has become a valuable source of patient education material. A significant percentage of patients, however, find this Internet based information confusing. Healthcare experts recommend that the readability of patient education material be less than the sixth grade level. The Flesch-Kincaid grade level is the most widely used method to evaluate the readability score of textual material, with lower scores suggesting easier readability.  We conducted an Internet search of all patient education documents on the North American Spine Society (NASS), American Association of Neurological Surgeons (AANS), the American Academy of Orthopaedic Surgeons (AAOS), and a sample of 10 individual surgeon or practice based websites. The Flesch-Kincaid grade level of each article was calculated using widely available Microsoft Office Word software. The mean grade level of articles on the various professional society and individual/practice based websites were compared.  A total of 121 articles from the various websites were available and analyzed. All 4 categories of websites had mean Flesch-Kincaid grade levels greater than 10. Only 3 articles (2.5%) were found to be at or below the sixth grade level, the recommended readability level for adult patients in the United States. There were no significant differences among the mean Flesch-Kincaid grade levels from the AAOS, NASS, AANS, and practice-based web-sites (P = 0.065, ANOVA).  Our findings suggest that most of the Spine-related patient education materials on professional society and practice-based websites have readability scores that may be too high, making comprehension difficult for a substantial portion of the United States adult population.

title: Readability of arthroscopy-related patient education materials from the American Academy of Orthopaedic Surgeons and Arthroscopy Association of North America Web sites.
abstract: We sought to assess the readability levels of arthroscopy-related patient education materials available on the Web sites of the American Academy of Orthopaedic Surgeons (AAOS) and the Arthroscopy Association of North America (AANA). We identified all articles related to arthroscopy available in 2012 from the online patient education libraries of AAOS and AANA. After performing follow-up editing, we assessed each article with the Flesch-Kincaid (FK) readability test. Mean readability levels of the articles from the AAOS Web site and the AANA Web site were compared. We also determined the number of articles with readability levels at or below the eighth-grade level (the average reading ability of the US adult population) and sixth-grade level (the widely recommended level for patient education materials). Intraobserver reliability and interobserver reliability of FK grade assessment were evaluated. A total of 62 articles were reviewed (43 from AAOS and 19 from AANA). The mean overall FK grade level was 10.2 (range, 5.2 to 12). The AAOS articles had a mean FK grade level of 9.6 (range, 5.2 to 12), whereas the AANA articles had a mean FK grade level of 11.4 (range, 8.7 to 12); the difference was significant (P < .0001). Only 3 articles had a readability level at or below the eighth-grade level and only 1 was at or below the sixth-grade level; all were from AAOS. Intraobserver reliability and interobserver reliability were excellent (intraclass correlation coefficient of 1 for both). Online patient education materials related to arthroscopy from AAOS and AANA may be written at a level too difficult for a large portion of the patient population to comprehend.

title: Readability of online patient education materials on adult reconstruction Web sites.
abstract: Recommended readability of patient education materials is sixth-grade level or lower. Readability of 212 patient education materials pertaining to adult reconstruction topics available from the American Academy of Orthopaedic Surgeons, American Association of Hip and Knee Surgeons, and 3 other specialty and private practitioner Web sites was assessed using the Flesch-Kincaid grade formula. The mean Flesch-Kincaid score was 11.1 (range, 3-26.5). Only 5 (2%) articles had a readability level of sixth grade or lower. Readability of most of the articles for patient education on adult reconstruction Web sites evaluated may be too advanced for a substantial portion of patients. Further studies are needed to assess the optimal readability level of health information on the Internet.

title: Health information on the internet
abstract: We did a prevalence survey among patients attending Obstetrics and Gynaecology clinics on internet-based health information accessed by our patients. Nearly 60% of patients had accessed web-based information before attending our specialist clinics. But only 4% were aware of the recommended website from which to access information. The patients felt the information obtained through common search engines like Yahoo and Google were unclear and confusing. With increasing access to internet-based health information, the medical community needs to address the problems of web-based health information and direct the patients to evaluated and approved websites.

title: Activity Profile of Members of an Online Health Community After Articular Cartilage Repair of the Knee
abstract: Articular cartilage repair (ACR) procedures aim to alleviate pain and restore function for individuals with chondral defects. Rehabilitation is lengthy, and there are limited data on return to sports and exercise activities after ACR in non-elite-athlete populations. The Internet is a growing source of health-related information for patients, and it has resulted in the emergence of online health communities.  To establish a postoperative activity profile of users of an online health community who have undergone ACR of the knee and to compare this profile with those from the same community who have undergone initial anterior cruciate ligament reconstruction (ACLR).  Tegner Activity Scale ratings were collected via a self-reported online questionnaire from 201 participants of an online health community who had undergone tibiofemoral and/or patellofemoral ACR (n = 75) or ACLR (n = 126).  A higher Tegner activity level was significantly correlated to time from surgery for ACR (P < 0.005) and ACLR (P < 0.01). At a minimum of 24 months’ follow-up, the ACR group had a median postoperative Tegner score of 3, compared with 6 for the ACLR group. Tegner score was significantly negatively correlated with age at time of surgery for ACLR (P < 0.05) but not for ACR. Men demonstrated significantly higher Tegner activity levels than did women for both ACLR and ACR (P < 0.05).  Activity levels after ACR in this population increased with postoperative time but remained lower than expected when compared with current published clinical and normative data.  Engagement with an online health community may influence expectations regarding return to sports and exercise activities. Reporting of activity-level data within clinical studies should be differentiated on the basis of sex. Further research is needed to elucidate factors that determine return to sports and exercise activities after ACR.