Position: Senior Data Engineer
Company: AOG.jobs
Category: Data Engineer
Experience required: 5y
English level: upper
Published: 2022-04-01T00:00:00+03:00

The client (Based in Denmark)

We are on a journey from IaaS based Microsoft/QV solutions to Azure PaaS with the use of well-known tools and solutions like ADF, Data lake, Synapse, Analysis Services, and DataBricks.
Team Player Passionate About Data And Engineering
Some would say that you are a real team player, product-oriented, can-do attitude, and with good stakeholder management skills. You are structured and analytical, always aiming to achieve great results. Furthermore, you are a confident communicator and have the ability to explain your solution design and tailor the message according to the audience.

**Further to this, you will:**
1.    Work closely with your colleagues within a product team to design scalable, efficient, and stable products
2.    Work closely with product owners to build and deliver features designed to support the client to drive commercial business cases and efficiencies within reporting and analytics and other data-driven use cases
3.    Create and maintain high-quality data pipeline architecture
4.    Obtain relevant business and system knowledge to convert requirements efficiently to technical design documentation and conceptual data modeling
5.    Ingest large, complex data sets, automate manual processes, optimize data delivery, improve data quality, etc.
6.    Own your data products and track continuous stability and benefits
7.    Live and breathe a “build-once-consume-many” culture in which we enable others to use our data products for maximum value-add
8.    Work with stakeholders and teams to assist with data-related technical challenges
9.    Follow best practices and existing guidelines but also push the limits
10.  Thrive in a fast-paced environment and you get motivated by challenges as a true problem solver.

**You’re perfect for this role if you have:**
1.    Relevant education in Computer Science, Mathematics, Economics, Information Management, or Statistics
2.    3+ years of experience as a Data Engineer or in a Software engineering role with a focus on data
3.    Proven experience with ADF, Data Lake, Synapse, T/U-SQL, DataBricks, MDS, DAX, PowerBI, and SQL Server
4.    Experience with at least one object-oriented or functional/scripting language – Java, Scala, Python, etc.
5.    DevOps and CI/CD focus
6.    Hands-on with Git and coding best practice
7.    Unit testing
8.    Experience in working with relational data sets using SQL
9.    Experience with data warehousing, dimensional modeling, and cubes
10.  Experience in building, and optimizing data pipelines, architectures, and datasets
11.  Experience in working with Azure, AWS, or other cloud providers
12.  Designed, built, and delivered production-ready data products at an enterprise level
13.  Highly proficient in English and able to communicate with all levels
14.  Agile mindset and experience of Scrum

**It’s a plus if you have worked with:**
1.    Big data: Spark, Hadoop
2.    Data pipeline and workflow tools: Airflow
3.    Infrastructure: Kubernetes and Helm; we’re using Airflow running on Kubernetes
4.    Stream-processing systems: Kafka or Spark Streaming

**We Offer:**
Start Date - ASAP
**Duration - until the end of the year**
Any location, open to Ukrainians
Remote
Full-time

**We don`t cooperate with Russian Federation and Belarus**