Graphcore
/

vit-base-ipu

Model card Files Files and versions Community

jimypbr commited on Jan 12, 2022

Commit

f77384d

•

1 Parent(s): b1115b3

Update ipu_config.json

gradient accumulation -> 128

Files changed (1) hide show

ipu_config.json +1 -1

ipu_config.json CHANGED Viewed

@@ -6,7 +6,7 @@
     "enable_half_partials": true,
     "replication_factor": 4,
-    "gradient_accumulation_steps": 16,
     "device_iterations": 1,
     "executable_cache_dir": "./exe_cache",

     "enable_half_partials": true,
     "replication_factor": 4,
+    "gradient_accumulation_steps": 128,
     "device_iterations": 1,
     "executable_cache_dir": "./exe_cache",