Graphcore
/

roberta-base-ipu

Model card Files Files and versions Community

jimypbr commited on Apr 8, 2022

Commit

1898872

•

1 Parent(s): c7c1e5b

Update ipu_config.json

set optimizer state off-chip

Files changed (1) hide show

ipu_config.json +1 -1

ipu_config.json CHANGED Viewed

@@ -1,7 +1,7 @@
 {
   "embedding_serialization_factor": 0,
   "recompute_checkpoint_every_layer": true,
-  "optimizer_state_offchip": false,
   "replicated_tensor_sharding": true,
   "enable_half_first_order_momentum": true,
   "enable_half_partials": true,

 {
   "embedding_serialization_factor": 0,
   "recompute_checkpoint_every_layer": true,
+  "optimizer_state_offchip": true,
   "replicated_tensor_sharding": true,
   "enable_half_first_order_momentum": true,
   "enable_half_partials": true,