rubra-ai
/

Phi-3-mini-128k-instruct

Text Generation

function-calling

text-generation-inference

Inference Endpoints

Model card Files Files and versions Metrics Training metrics Community

sanjay920 commited on Jul 9

Commit

64faf7c

•

1 Parent(s): 3855fa9

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -68,7 +68,7 @@ The model is the result of further post-training [microsoft/Phi-3-mini-128k-inst
 | Model                                        | Function Calling | MMLU  | GPQA  | GSM-8K | MATH  | MT-bench | Win | Loss | Tie | Win Rate | Loss Rate | Adjusted Win Rate |
 |----------------------------------------------|------------------|-------|-------|--------|-------|----------|-----|------|-----|----------|-----------|-------------------|
 | Phi-3 Mini 128k Instruct (June)              | -                | 69.36 | 27.01 | 83.7   | 32.92 | 8.02     | 21  | 72   | 67  | 0.13125  | 0.45000   | 0.340625          |
-| Rubra Enhanced Phi-3 Mini 128k Instruct (June)| 75.00%               | 67.87 | 29.69 | 79.45  | 30.80 | 8.21     | 72  | 21   | 67  | 0.45000  | 0.13125   | **0.659375**      |
 | Phi-3 Mini 128k Instruct (April)             | -                | 68.17 | 25.90 | 80.44  | 28.12 | 7.92     | 51  | 45   | 64  | 0.31875  | 0.28125   | 0.51875           |
 | Rubra Enhanced Phi-3 Mini 128k Instruct (April)| 65.71%           | 66.66 | 29.24 | 74.09  | 26.84 | 7.45     | 45  | 51   | 64  | 0.28125  | 0.31875   | 0.48125         |
 * Commit `e2ecb24bd9dae689bb30dafcf13cbbc9dbddead5` is the last commit to have the April-based Phi-3 model. The latest in main is built off the June model

 | Model                                        | Function Calling | MMLU  | GPQA  | GSM-8K | MATH  | MT-bench | Win | Loss | Tie | Win Rate | Loss Rate | Adjusted Win Rate |
 |----------------------------------------------|------------------|-------|-------|--------|-------|----------|-----|------|-----|----------|-----------|-------------------|
 | Phi-3 Mini 128k Instruct (June)              | -                | 69.36 | 27.01 | 83.7   | 32.92 | 8.02     | 21  | 72   | 67  | 0.13125  | 0.45000   | 0.340625          |
+| Rubra Enhanced Phi-3 Mini 128k Instruct (June)| 70.00%               | 67.87 | 29.69 | 79.45  | 30.80 | 8.21     | 72  | 21   | 67  | 0.45000  | 0.13125   | **0.659375**      |
 | Phi-3 Mini 128k Instruct (April)             | -                | 68.17 | 25.90 | 80.44  | 28.12 | 7.92     | 51  | 45   | 64  | 0.31875  | 0.28125   | 0.51875           |
 | Rubra Enhanced Phi-3 Mini 128k Instruct (April)| 65.71%           | 66.66 | 29.24 | 74.09  | 26.84 | 7.45     | 45  | 51   | 64  | 0.28125  | 0.31875   | 0.48125         |
 * Commit `e2ecb24bd9dae689bb30dafcf13cbbc9dbddead5` is the last commit to have the April-based Phi-3 model. The latest in main is built off the June model