Revert "Test build with no gradient"

This reverts commit 8108e51c2c572e8e5365306f91ec611604b470be.