DOI: 10.5281/zenodo.11630147
title: intron-innovation/AfriMed-QA: AfriMed-QA-v-1.2

description: What's Changed



Evalauting Pipeline for AfriMed-QA by @owos in https://github.com/intron-innovation/AfriMed-QA/pull/1

PR to support few shot evalution and instruction tuning  by @owos in https://github.com/intron-innovation/AfriMed-QA/pull/2

Gpt4o by @tobiolatunji in https://github.com/intron-innovation/AfriMed-QA/pull/3

PR to fix evaluation error. by @owos in https://github.com/intron-innovation/AfriMed-QA/pull/4

Ab eval by @tobiolatunji in https://github.com/intron-innovation/AfriMed-QA/pull/7

edit prompt structure by @owos in https://github.com/intron-innovation/AfriMed-QA/pull/8

Gpt4o by @tobiolatunji in https://github.com/intron-innovation/AfriMed-QA/pull/10

Gpt3.5turbo results by @SanniM3 in https://github.com/intron-innovation/AfriMed-QA/pull/9

Gpt4o by @tobiolatunji in https://github.com/intron-innovation/AfriMed-QA/pull/11

Gpt4o by @tobiolatunji in https://github.com/intron-innovation/AfriMed-QA/pull/14

all results from my end by @owos in https://github.com/intron-innovation/AfriMed-QA/pull/15

results for gpt4turbo and claude sonnet  by @SanniM3 in https://github.com/intron-innovation/AfriMed-QA/pull/16

updated readme by @princenimo in https://github.com/intron-innovation/AfriMed-QA/pull/18

Inference results for meditron, pmc llama, mistral, and openbio by @princenimo in https://github.com/intron-innovation/AfriMed-QA/pull/17

claude opus results by @SanniM3 in https://github.com/intron-innovation/AfriMed-QA/pull/19

Push results from claude_3_haiku run by @timfaniran in https://github.com/intron-innovation/AfriMed-QA/pull/20

Results for MedLM by @owos in https://github.com/intron-innovation/AfriMed-QA/pull/21

Results for 7 models by @princenimo in https://github.com/intron-innovation/AfriMed-QA/pull/22

Support to Eval MedQA by @owos in https://github.com/intron-innovation/AfriMed-QA/pull/23

push new data version by @tobiolatunji in https://github.com/intron-innovation/AfriMed-QA/pull/24

Update README.md by @princenimo in https://github.com/intron-innovation/AfriMed-QA/pull/25

PR for results from google models by @owos in https://github.com/intron-innovation/AfriMed-QA/pull/26

instruction tuning results  by @SanniM3 in https://github.com/intron-innovation/AfriMed-QA/pull/27

updated results for instruct and few shot - gpt4o and claude by @SanniM3 in https://github.com/intron-innovation/AfriMed-QA/pull/29

Add files via upload by @princenimo in https://github.com/intron-innovation/AfriMed-QA/pull/30

MedQA Google Models by @owos in https://github.com/intron-innovation/AfriMed-QA/pull/28

More Google Results on MedQA by @owos in https://github.com/intron-innovation/AfriMed-QA/pull/31

Google Models: Fews shots + instruct Prompt  by @owos in https://github.com/intron-innovation/AfriMed-QA/pull/32

Add files via upload by @tejuafonja in https://github.com/intron-innovation/AfriMed-QA/pull/33

Medqa afrimed qa 3 shot by @princenimo in https://github.com/intron-innovation/AfriMed-QA/pull/34

Google models, Instruct Only  by @owos in https://github.com/intron-innovation/AfriMed-QA/pull/35

Update README.md by @princenimo in https://github.com/intron-innovation/AfriMed-QA/pull/36


New Contributors



@owos made their first contribution in https://github.com/intron-innovation/AfriMed-QA/pull/1

@tobiolatunji made their first contribution in https://github.com/intron-innovation/AfriMed-QA/pull/3

@SanniM3 made their first contribution in https://github.com/intron-innovation/AfriMed-QA/pull/9

@princenimo made their first contribution in https://github.com/intron-innovation/AfriMed-QA/pull/18

@timfaniran made their first contribution in https://github.com/intron-innovation/AfriMed-QA/pull/20

@tejuafonja made their first contribution in https://github.com/intron-innovation/AfriMed-QA/pull/33


Full Changelog: https://github.com/intron-innovation/AfriMed-QA/commits/version-1