WilhelmT commited on
Commit
d26b351
·
1 Parent(s): 100a273

Remove NVFP4A16 and W4A16 from Physical AI Bench

Browse files
Files changed (1) hide show
  1. data/acc-Cosmos-Reason2.csv +0 -2
data/acc-Cosmos-Reason2.csv CHANGED
@@ -1,6 +1,4 @@
1
  Model,Overall,Embodied Reasoning,Common Sense,AV,Physical World,Time,Space,Agibot,HoloAssist,RoboFail,RoboVQA,BridgeData V2
2
  nvidia/Cosmos-Reason2-2B,52.64,55.25,50.00,45.00,49.11,50.00,52.50,39.00,65.00,52.00,88.18,39.00
3
- embedl/Cosmos-Reason2-2B-NVFP4A16,49.84,50.16,49.50,44.00,45.13,52.01,52.50,28.00,58.00,51.00,84.55,32.00
4
- embedl/Cosmos-Reason2-2B-W4A16,48.68,50.49,46.85,36.00,47.79,44.30,53.75,36.00,61.00,42.00,80.91,44.00
5
  embedl/Cosmos-Reason2-2B-W4A16-Edge2,51.73,54.43,49.01,48.00,46.46,50.34,51.25,41.00,58.00,56.00,85.45,35.00
6
  embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead,51.48,54.26,48.68,47.00,45.13,50.34,52.50,42.00,61.00,53.00,86.36,33.00
 
1
  Model,Overall,Embodied Reasoning,Common Sense,AV,Physical World,Time,Space,Agibot,HoloAssist,RoboFail,RoboVQA,BridgeData V2
2
  nvidia/Cosmos-Reason2-2B,52.64,55.25,50.00,45.00,49.11,50.00,52.50,39.00,65.00,52.00,88.18,39.00
 
 
3
  embedl/Cosmos-Reason2-2B-W4A16-Edge2,51.73,54.43,49.01,48.00,46.46,50.34,51.25,41.00,58.00,56.00,85.45,35.00
4
  embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead,51.48,54.26,48.68,47.00,45.13,50.34,52.50,42.00,61.00,53.00,86.36,33.00