Aurametrix/dermatology_longitudinal huggingface dataset:
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of claude-instant-v1.0 (Claude series) — tinea corporis: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Tinea corporis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — impetigo: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Impetigo (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — erythrasma: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Erythrasma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — dermatomyositis: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Dermatomyositis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — scleroderma: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Scleroderma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — morphea: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Morphea (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of claude-instant-v1.0 (Claude series) — dermatomyositis: overall quality of generated text as a source of information
Condition/subject: Dermatomyositis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — atopic eczema: NOT harmfulness
Condition/subject: Atopic eczema (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — psoriasis: NOT harmfulness
Condition/subject: Psoriasis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — an abscess: NOT harmfulness
Condition/subject: Abscess (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — warts: NOT harmfulness
Condition/subject: Warts (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — malignant melanoma: NOT harmfulness
Condition/subject: Melanoma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — actinic keratosis: NOT harmfulness
Condition/subject: Actinic Keratosis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of claude-instant-v1.0 (Claude series) — chronic urticaria: NOT harmfulness
Condition/subject: Chronic urticaria (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — pyoderma gangrenosum: NOT harmfulness
Condition/subject: Pyoderma gangrenosum (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — shingles: NOT harmfulness
Condition/subject: Shingles (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — fungal nail infections: NOT harmfulness
Condition/subject: Fungal nail infections (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — pityriasis versicolor: NOT harmfulness
Condition/subject: Pityriasis versicolor (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — impetigo: NOT harmfulness
Condition/subject: Impetigo (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — dermatomyositis: NOT harmfulness
Condition/subject: Dermatomyositis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of claude-instant-v1.0 (Claude series) — scleroderma: NOT harmfulness
Condition/subject: Scleroderma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — morphea: NOT harmfulness
Condition/subject: Morphea (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — psoriasis: NOT Falsness
Condition/subject: Psoriasis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — an abscess: NOT Falsness
Condition/subject: Abscess (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — chronic urticaria: NOT Falsness
Condition/subject: Chronic urticaria (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — pyoderma gangrenosum: NOT Falsness
Condition/subject: Pyoderma gangrenosum (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — dermatomyositis: NOT Falsness
Condition/subject: Dermatomyositis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of claude-instant-v1.0 (Claude series) — scleroderma: NOT Falsness
Condition/subject: Scleroderma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — morphea: NOT Falsness
Condition/subject: Morphea (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — morphea: Objectives Clear and Achieved
Condition/subject: Morphea (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — basal cell carcinoma:  information presented is balanced and unbiased
Condition/subject: Basal Cell Carcinoma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — morphea:  information presented is balanced and unbiased
Condition/subject: Morphea (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — warts: mode of action of each treatment procedure described
Condition/subject: Warts (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of command-xlarge-nightly (Cohere series) — atopic eczema: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Atopic eczema (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — psoriasis: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Psoriasis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — discoid lupus erythematosus: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Discoid lupus erythematosus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — warts: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Warts (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — basal cell carcinoma: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Basal Cell Carcinoma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of command-xlarge-nightly (Cohere series) — actinic keratosis: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Actinic Keratosis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — morphea: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Morphea (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — atopic eczema: NOT harmfulness
Condition/subject: Atopic eczema (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — psoriasis: NOT harmfulness
Condition/subject: Psoriasis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — an abscess: NOT harmfulness
Condition/subject: Abscess (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — discoid lupus erythematosus: NOT harmfulness
Condition/subject: Discoid lupus erythematosus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of command-xlarge-nightly (Cohere series) — a clavus: NOT harmfulness
Condition/subject: Clavus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — warts: NOT harmfulness
Condition/subject: Warts (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — basal cell carcinoma: NOT harmfulness
Condition/subject: Basal Cell Carcinoma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — malignant melanoma: NOT harmfulness
Condition/subject: Melanoma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — actinic keratosis: NOT harmfulness
Condition/subject: Actinic Keratosis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — chronic urticaria: NOT harmfulness
Condition/subject: Chronic urticaria (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — pyoderma gangrenosum: NOT harmfulness
Condition/subject: Pyoderma gangrenosum (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of command-xlarge-nightly (Cohere series) — shingles: NOT harmfulness
Condition/subject: Shingles (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — fungal nail infections: NOT harmfulness
Condition/subject: Fungal nail infections (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — pityriasis versicolor: NOT harmfulness
Condition/subject: Pityriasis versicolor (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — tinea corporis: NOT harmfulness
Condition/subject: Tinea corporis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — impetigo: NOT harmfulness
Condition/subject: Impetigo (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — erythrasma: NOT harmfulness
Condition/subject: Erythrasma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — dermatomyositis: NOT harmfulness
Condition/subject: Dermatomyositis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of command-xlarge-nightly (Cohere series) — scleroderma: NOT harmfulness
Condition/subject: Scleroderma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — morphea: NOT harmfulness
Condition/subject: Morphea (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — atopic eczema: NOT Falsness
Condition/subject: Atopic eczema (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — psoriasis: NOT Falsness
Condition/subject: Psoriasis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — an abscess: NOT Falsness
Condition/subject: Abscess (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — discoid lupus erythematosus: NOT Falsness
Condition/subject: Discoid lupus erythematosus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — warts: NOT Falsness
Condition/subject: Warts (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of command-xlarge-nightly (Cohere series) — basal cell carcinoma: NOT Falsness
Condition/subject: Basal Cell Carcinoma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — malignant melanoma: NOT Falsness
Condition/subject: Melanoma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — actinic keratosis: NOT Falsness
Condition/subject: Actinic Keratosis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — chronic urticaria: NOT Falsness
Condition/subject: Chronic urticaria (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — pyoderma gangrenosum: NOT Falsness
Condition/subject: Pyoderma gangrenosum (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — shingles: NOT Falsness
Condition/subject: Shingles (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — fungal nail infections: NOT Falsness
Condition/subject: Fungal nail infections (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of command-xlarge-nightly (Cohere series) — pityriasis versicolor: NOT Falsness
Condition/subject: Pityriasis versicolor (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — impetigo: NOT Falsness
Condition/subject: Impetigo (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — erythrasma: NOT Falsness
Condition/subject: Erythrasma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — scleroderma: NOT Falsness
Condition/subject: Scleroderma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — morphea: NOT Falsness
Condition/subject: Morphea (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of GPT-3.5 Turbo (GPT series) — Dermatology medical content generated, falsness
Condition/subject: Patient Education (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 60)
Comments: Claude-instant-v1.0 demonstrated the highest falseness ratings in ophthalmology (68.4%, 95% CI 47%-89.9%) and dermatology (65%, 95% CI 43.6%-86.4%), while GPT-3.5-Turbo exhibited the lowest rating in dermatology (0%, 95% CI 0%-0%).
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of gpt-3.5-turbo (GPT series) — discoid lupus erythematosus: Objectives Clear and Achieved
Condition/subject: Discoid lupus erythematosus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — a clavus: Objectives Clear and Achieved
Condition/subject: Clavus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — discoid lupus erythematosus:  information presented is balanced and unbiased
Condition/subject: Discoid lupus erythematosus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — atopic eczema: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Atopic eczema (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — psoriasis: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Psoriasis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — discoid lupus erythematosus: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Discoid lupus erythematosus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of gpt-3.5-turbo (GPT series) — a clavus: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Clavus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — warts: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Warts (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — basal cell carcinoma: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Basal Cell Carcinoma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — malignant melanoma: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Melanoma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — actinic keratosis: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Actinic Keratosis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — pityriasis versicolor: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Pityriasis versicolor (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of gpt-3.5-turbo (GPT series) — impetigo: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Impetigo (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — dermatomyositis: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Dermatomyositis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — morphea: Is it clearly presented that more than one possible treatment procedure may exist
Condition/subject: Morphea (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — discoid lupus erythematosus: the information is an aid to "shared decision-making"
Condition/subject: Discoid lupus erythematosus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — actinic keratosis: the information is an aid to "shared decision-making"
Condition/subject: Actinic Keratosis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — atopic eczema: NOT harmfulness
Condition/subject: Atopic eczema (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of gpt-3.5-turbo (GPT series) — psoriasis: NOT harmfulness
Condition/subject: Psoriasis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — an abscess: NOT harmfulness
Condition/subject: Abscess (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — discoid lupus erythematosus: NOT harmfulness
Condition/subject: Discoid lupus erythematosus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — a clavus: NOT harmfulness
Condition/subject: Clavus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — warts: NOT harmfulness
Condition/subject: Warts (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — basal cell carcinoma: NOT harmfulness
Condition/subject: Basal Cell Carcinoma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — malignant melanoma: NOT harmfulness
Condition/subject: Melanoma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 100.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity