Set up proper Kafka env in provision script

kanban #1361236