Remove tracked json in ap_provision. From now on they won't be tracked