Before revision:  Here, we introduce a general in-the-loop learning framework  that resolves these issues.
After revision:  Here, we introduce a general in-the-loop learning framework based on surrogate gradients that resolves these issues.