Position: DevOps engineer with Azure
Company: Luxoft
Experience required: 2y
Category: DevOps
English level: upper
Published: 2022-05-01T00:00:00+03:00

Project Description:
As DevOps Engineer you'll be working with alongside data engineers and architects to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, interpretation and visualization. You will be creating the pipeline for data processing, data visualization, and analytics products, including automated services, and APIs.

You seek to grow your expertise in the different infrastructures, tools and applications, and stages of advanced analytic workflows. You are inventive and passionate about streamlining and automating data acquisition and possess a highly structured approach to problem solving.

You will be the go-to person for end-to-end data handling, management and analytics processes
Responsibilities:
Minimal requirements:
1. Strong experience with Microsoft Azure DevOps (incl. YAML pipelines)
2. Scripting skills in Python/PowerShell
3. Knowledge and practice with ADF, DataBricks streaming (basics),
4. Knowledge and practice with Streaming (Kafka/Event Hub/ Bus Service)
5. Experience with CI\CD model
6. Azure Monitor
        - Integration
        - Log Analytics workspace
        - Databricks cluster monitoring , logs, alerting
7. Machine learning knowledge

Responsibilities
• Ingest data-sources into our data management platforms
• Structure data into a scalable and easily understood architecture
• Work in a multi-disciplined team where you'll turn data discoveries and ideas into models and insights. You'll find how to leverage the data and the models to create and improve products for our customers, in lean development cycles.
• Be able to implement/build methodologies as well as (understand how to) scale them together with the businesses;
• Maintain a good, current and demonstrable knowledge of adjacent application and market developments both for inspiration and for benchmarking the concepts.
Mandatory Skills Description:Azure DevOps, Microsoft Azure Cloud Platform, Microsoft Azure Data Factory, Python, Microsoft Azure Databricks
Nice-to-Have Skills:Data Engineering, Microsoft Azure Kubernetes Service (AKS), Apache Airflow, Microsoft Azure Networking, Site Reliability Engineer