Aurametrix/dermatology_longitudinal huggingface dataset:
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of command-xlarge-nightly (Cohere series) — basal cell carcinoma: Additional Sources Listed
Condition/subject: Basal Cell Carcinoma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — actinic keratosis: Additional Sources Listed
Condition/subject: Actinic Keratosis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — pyoderma gangrenosum: Additional Sources Listed
Condition/subject: Pyoderma gangrenosum (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — tinea corporis: Additional Sources Listed
Condition/subject: Tinea corporis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — scleroderma: Additional Sources Listed
Condition/subject: Scleroderma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — morphea: Additional Sources Listed
Condition/subject: Morphea (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of command-xlarge-nightly (Cohere series) — psoriasis: mode of action of each treatment procedure described
Condition/subject: Psoriasis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — discoid lupus erythematosus: mode of action of each treatment procedure described
Condition/subject: Discoid lupus erythematosus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — shingles: mode of action of each treatment procedure described
Condition/subject: Shingles (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — pityriasis versicolor: mode of action of each treatment procedure described
Condition/subject: Pityriasis versicolor (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — scleroderma: mode of action of each treatment procedure described
Condition/subject: Scleroderma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — psoriasis: benefits of each treatment procedure described
Condition/subject: Psoriasis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of command-xlarge-nightly (Cohere series) — discoid lupus erythematosus: benefits of each treatment procedure described
Condition/subject: Discoid lupus erythematosus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — actinic keratosis: benefits of each treatment procedure described
Condition/subject: Actinic Keratosis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — psoriasis: risks of each treatment procedure described
Condition/subject: Psoriasis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — warts: risks of each treatment procedure described
Condition/subject: Warts (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — psoriasis: Is it described how the treatment procedures affect quality of life
Condition/subject: Psoriasis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — warts: Is it described how the treatment procedures affect quality of life
Condition/subject: Warts (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of command-xlarge-nightly (Cohere series) — shingles: Is it described how the treatment procedures affect quality of life
Condition/subject: Shingles (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — scleroderma: Is it described how the treatment procedures affect quality of life
Condition/subject: Scleroderma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — an abscess: the information is an aid to "shared decision-making"
Condition/subject: Abscess (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — a clavus: the information is an aid to "shared decision-making"
Condition/subject: Clavus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — malignant melanoma: the information is an aid to "shared decision-making"
Condition/subject: Melanoma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — dermatomyositis: the information is an aid to "shared decision-making"
Condition/subject: Dermatomyositis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of command-xlarge-nightly (Cohere series) — scleroderma: the information is an aid to "shared decision-making"
Condition/subject: Scleroderma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — malignant melanoma: overall quality of generated text as a source of information
Condition/subject: Melanoma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — chronic urticaria: overall quality of generated text as a source of information
Condition/subject: Chronic urticaria (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — pityriasis versicolor: overall quality of generated text as a source of information
Condition/subject: Pityriasis versicolor (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — dermatomyositis: overall quality of generated text as a source of information
Condition/subject: Dermatomyositis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of command-xlarge-nightly (Cohere series) — scleroderma: overall quality of generated text as a source of information
Condition/subject: Scleroderma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of gpt-3.5-turbo (GPT series) — fungal nail infections:  information presented is balanced and unbiased
Condition/subject: Fungal nail infections (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — pityriasis versicolor:  information presented is balanced and unbiased
Condition/subject: Pityriasis versicolor (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — tinea corporis:  information presented is balanced and unbiased
Condition/subject: Tinea corporis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — atopic eczema: Additional Sources Listed
Condition/subject: Atopic eczema (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — psoriasis: Additional Sources Listed
Condition/subject: Psoriasis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — an abscess: Additional Sources Listed
Condition/subject: Abscess (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of gpt-3.5-turbo (GPT series) — discoid lupus erythematosus: Additional Sources Listed
Condition/subject: Discoid lupus erythematosus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — a clavus: Additional Sources Listed
Condition/subject: Clavus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — basal cell carcinoma: Additional Sources Listed
Condition/subject: Basal Cell Carcinoma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — actinic keratosis: Additional Sources Listed
Condition/subject: Actinic Keratosis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — chronic urticaria: Additional Sources Listed
Condition/subject: Chronic urticaria (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — pyoderma gangrenosum: Additional Sources Listed
Condition/subject: Pyoderma gangrenosum (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — shingles: Additional Sources Listed
Condition/subject: Shingles (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of gpt-3.5-turbo (GPT series) — scleroderma: Additional Sources Listed
Condition/subject: Scleroderma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — morphea: Additional Sources Listed
Condition/subject: Morphea (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — psoriasis: mode of action of each treatment procedure described
Condition/subject: Psoriasis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — an abscess: mode of action of each treatment procedure described
Condition/subject: Abscess (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — warts: mode of action of each treatment procedure described
Condition/subject: Warts (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — malignant melanoma: mode of action of each treatment procedure described
Condition/subject: Melanoma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of gpt-3.5-turbo (GPT series) — chronic urticaria: mode of action of each treatment procedure described
Condition/subject: Chronic urticaria (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — shingles: mode of action of each treatment procedure described
Condition/subject: Shingles (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — tinea corporis: mode of action of each treatment procedure described
Condition/subject: Tinea corporis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — impetigo: mode of action of each treatment procedure described
Condition/subject: Impetigo (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — erythrasma: mode of action of each treatment procedure described
Condition/subject: Erythrasma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — psoriasis: benefits of each treatment procedure described
Condition/subject: Psoriasis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of gpt-3.5-turbo (GPT series) — a clavus: benefits of each treatment procedure described
Condition/subject: Clavus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — scleroderma: benefits of each treatment procedure described
Condition/subject: Scleroderma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — psoriasis: risks of each treatment procedure described
Condition/subject: Psoriasis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — discoid lupus erythematosus: risks of each treatment procedure described
Condition/subject: Discoid lupus erythematosus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — a clavus: risks of each treatment procedure described
Condition/subject: Clavus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — atopic eczema: Is it described how the treatment procedures affect quality of life
Condition/subject: Atopic eczema (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of gpt-3.5-turbo (GPT series) — scleroderma: Is it described how the treatment procedures affect quality of life
Condition/subject: Scleroderma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — morphea: the information is an aid to "shared decision-making"
Condition/subject: Morphea (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — chronic urticaria: overall quality of generated text as a source of information
Condition/subject: Chronic urticaria (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — fungal nail infections: overall quality of generated text as a source of information
Condition/subject: Fungal nail infections (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — pityriasis versicolor: overall quality of generated text as a source of information
Condition/subject: Pityriasis versicolor (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of gpt-3.5-turbo (GPT series) — tinea corporis: overall quality of generated text as a source of information
Condition/subject: Tinea corporis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 40.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of Claude-instant-v1.0 (Claude series) — Dermatologic, Ophthalmologic and Orthopedic information generated by LLM (treatment recommendations for 60 diseases, including 19 ophthalmologic, 21 orthopedic and 20 dermatologic diseases: atopic eczema, psoriasis, an abscess, discoid lupus erythematosus, a clavus, warts, basal cell carcinoma, malignant melanoma, actinic keratosis, chronic urticaria, pyoderma gangrenosum, shingles, fungal nail infections, pityriasis versicolor, tinea corporis, impetigo, erythrasma, dermatomyositis, scleroderma, morphea)
Condition/subject: pediatric, infectious and autoimmune dermatology (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 48.30% (sample size: 180)
Comments: The overall accuracy, defined as the absence of harmfulness and falseness, was highest for GPT-3.5-Turbo (88.3%, 95% CI 80.1%-96.5%) and was lowest for Claude-instant-v1.0 (48.3%, 95% CI 35.6%-61.1%).

Evaluation of bloomz (BLOOM series) — a clavus: NOT Falsness
Condition/subject: Clavus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of bloomz (BLOOM series) — warts: NOT Falsness
Condition/subject: Warts (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — a clavus: Objectives Clear and Achieved
Condition/subject: Clavus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — tinea corporis:  information presented is balanced and unbiased
Condition/subject: Tinea corporis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of claude-instant-v1.0 (Claude series) — impetigo: Additional Sources Listed
Condition/subject: Impetigo (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — psoriasis: mode of action of each treatment procedure described
Condition/subject: Psoriasis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — malignant melanoma: mode of action of each treatment procedure described
Condition/subject: Melanoma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — pityriasis versicolor: mode of action of each treatment procedure described
Condition/subject: Pityriasis versicolor (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — tinea corporis: mode of action of each treatment procedure described
Condition/subject: Tinea corporis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — impetigo: mode of action of each treatment procedure described
Condition/subject: Impetigo (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of claude-instant-v1.0 (Claude series) — atopic eczema: benefits of each treatment procedure described
Condition/subject: Atopic eczema (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — a clavus: benefits of each treatment procedure described
Condition/subject: Clavus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — chronic urticaria: benefits of each treatment procedure described
Condition/subject: Chronic urticaria (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — pityriasis versicolor: benefits of each treatment procedure described
Condition/subject: Pityriasis versicolor (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — warts: Is it described how the treatment procedures affect quality of life
Condition/subject: Warts (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — chronic urticaria: Is it described how the treatment procedures affect quality of life
Condition/subject: Chronic urticaria (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of claude-instant-v1.0 (Claude series) — shingles: Is it described how the treatment procedures affect quality of life
Condition/subject: Shingles (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — scleroderma: Is it described how the treatment procedures affect quality of life
Condition/subject: Scleroderma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — an abscess: the information is an aid to "shared decision-making"
Condition/subject: Abscess (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — discoid lupus erythematosus: the information is an aid to "shared decision-making"
Condition/subject: Discoid lupus erythematosus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — a clavus: the information is an aid to "shared decision-making"
Condition/subject: Clavus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — basal cell carcinoma: the information is an aid to "shared decision-making"
Condition/subject: Basal Cell Carcinoma (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity
Dataset: 20 dermatologic diseases out of 60 arbitrarily chosen diseases (19 ophthalmologic, 20 dermatologic, and 21 orthopedic)  - dermatology information (therapy recommendation) generated by LLM ranked by 3 specialist physicians
Reference (2023): Wilhelm TI, Roos J, Kaczmarczyk R. Large Language Models for Therapy Recommendations Across 3 Clinical Specialties: Comparative Study. J Med Internet Res. 2023 Oct 30;25:e49324. doi: 10.2196/49324. PMID: 37902826; PMCID: PMC10644179.

Evaluation of claude-instant-v1.0 (Claude series) — shingles: the information is an aid to "shared decision-making"
Condition/subject: Shingles (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — fungal nail infections: the information is an aid to "shared decision-making"
Condition/subject: Fungal nail infections (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — pityriasis versicolor: the information is an aid to "shared decision-making"
Condition/subject: Pityriasis versicolor (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — tinea corporis: the information is an aid to "shared decision-making"
Condition/subject: Tinea corporis (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — discoid lupus erythematosus: overall quality of generated text as a source of information
Condition/subject: Discoid lupus erythematosus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity

Evaluation of claude-instant-v1.0 (Claude series) — a clavus: overall quality of generated text as a source of information
Condition/subject: Clavus (English)
Category: Medication Recommendations and Treatment Efficacy — Clinical Practice
Validity/accuracy: 60.00% (sample size: 3)
Comments: Score derived from rankings of 3 specialist physicians on a scale 1 - 5, converted to percentages of accuracy/validity