@pwendell  I think it is still needed? since we do build against different yarn API and publish with the same name spark-yarn.