Before revision:  Our main insight is noticing that ES is already a distributed blackbox algorithm , and thus we may simply insert a model controllerfrom ENAS into the central aggregator in ES and obtain weight sharing properties for free .
After revision:  Our main insight is noticing that ES is already a highly distributed algorithm involving hundreds of forward passes which can not only be used for training neural network weights, but also for jointly training a NAS controller, both in a blackbox fashion .