Revert "Only use the embedded gem binary if we are using embedded ruby"

This reverts commit c83769ad96d3e8364e4a520225d8dfc39ac5bb35.