Uh, that's super easy...

erb doesn't interpret the yml, so we'll just do a sed replace on Jenkins before deployment
Upgrade to latest newrelic-agent