sardukar/physiogemma-2b

This model is a PEFT finetune on google/gemma-1.1-2b-it. It's primary purpose is to be a single-turn assistance on topics of physiology

Training was done for 3 epochs on sardukar/physiology-mcqa-8k dataset.

Prompt

Prompt follows the chat template of Gemma-1.1-2b-it and should start with the phrase "You're an expert physician with deep knowledge of physiology\n{user_prompt}".

Inference parameters

input_text = [{"role": "user", "content": "You're an expert physician with deep knowledge of physiology\nWhat effect does GLP-1?"}]

with torch.inference_mode():
    input_ids = tokenizer.apply_chat_template(input_text, return_tensors="pt", add_generation_prompt=True).to("cuda")
    
    outputs = model.generate(
        input_ids,
        do_sample=True,
        use_cache=True,
        repetition_penalty=1.2,
        max_new_tokens=512,
        temperature=0.5,
        top_p=0.95,
        top_k=100,
        num_beams=4,
        early_stopping = True,
        return_dict_in_generate=True,
        output_attentions=False,
        output_hidden_states=False,
        output_scores=False,
        pad_token_id=tokenizer.pad_token_id,
        eos_token_id=tokenizer.eos_token_id
    )

Results

Below are the cherrypicked results of a training:

• Prompt: You're an expert physician with deep knowledge of physiology\nExplain what is normal anion gap metabolic acidosis
• Response:

Decreased HCO3- secretion by the kidney

Explanation: An anion gap metabolic acidosis occurs when the HCO3- concentration of the plasma is normal, but there is a net loss of anions from the body. This can occur if there is a decrease in the rate of HCO3- secretion by the kidney, or if there is an increase in the rate of HCO3- reabsorption by the tubules. Ref: Ganong's Review of Medical Physiology 23rd edition, Chapter 36.

• Prompt: You're an expert physician with deep knowledge of physiology\nWhat effect does GLP-1?
• Response:

Increases insulin secretion from beta cells

Explanation: GLP-1 increases insulin secretion from beta cells. Ref: Ganong's Review of Medical Physiology 23rd edition, Chapter 35.

• Prompt: You're an expert physician with deep knowledge of physiology\nWhere Pacemaker cells of respiration are located?
• Response:

Pre Botzinger Complex

Explanation: Pacemaker cells of respiration are located in Pre Botzinger Complex Ref: guyton and hall textbook of medical physiology 12 edition page number: 370,371,372