Position: Senior Data Engineer
Company: GlobalLogic
Category: Data Science
Experience required: 3y
English level: intermediate
Published: 2021-11-01T00:00:00+02:00

The philosophy of our customer is that data resembles a water fountain. Every business and every desired team member should have access to data, as much or as little as they see fit. We know that no two customers are the same. Through our platform, technology dives deep to uncover the granular motivation behind the purchase of each consumer.

**Description:**
Client’s profuct helps leverage customer data via the most sophisticated application of new technologies to:
- Understand customer behavior at a level previously not possible.
- Identify the precise effect of advertising and promotions.
- Generate real time profiles of customer segments.
- Uncover the correlation between team member performance and customer loyalty.

**Business domain:** data processing.

**Requirements:**
- Excellent knowledge in Computer Science, Computing Theory, Data **Engineering:**
- Data Engineering, Big Data;
- Database theory (RDBMS, NoSQL);
- Data structures;
- Architectural, Enterprise Patterns.

**Practical commercial experience with:**
- Creation Data Solution on some of this technology: Spark (Scala or Python), Azure Ecosystem, Kafka or equivalent PaaS like Confluent; (3+ years of experience);
- RDBMS Systems (Netezza, Oracle, SQL Server, DB2) or even better Snowflake/Synapse/BigData;
- Linux/Unix Systems, scripting;
- NoSQL (e.g. Azure Cosmos DB);
- Version control systems (GIT);
- Cloud computing platforms (Microsoft Azure);
- Develop/test and deploy data solutions (mid to high complexity);
- Work automation(Including CI/CD practices such as Feature Branches, Unit Test automation and Release Cycles);
- Continuous Integration tools (e.g. Gitlab Pipeline, Jenkins, TeamCity, Bamboo).

**Experience with:**
- Troubleshooting, profiling and debugging applications;
- Creation software architecture and design of complex applications, platforms, microservices solutions;
- Agile software processes and technologies;
- Code Review process;
- Refactoring process;
- Upper-Intermediate English;
**Desirable**
- Cloud computing platforms (Microsoft Azure);
- SQL Experience is preferred but not needed if they can operate Spark;
- Understanding of orchestration and containerisation (Docker, Kubernetes);
- Practical commercial experience with Kubernetes (especially AKS) on production.

**Preferences:**
Databricks, Azure Datawarehouse, Kubernetes

**Responsibilities:**
- Develop Data Platform from scratch using a modern development environment and toolset (Azure tool suite: Azure Data Lake, Azure Databricks, Azure Devops; 
- Spark/Python-Scala) resulting in stable and high-quality code within deadlines, following established processes;
- Develop and maintain optimal data pipeline architecture;
- Maintain in-depth knowledge of the data ecosystem and trends; be a subject matter expert and thought leader;
- Taking part in the decision-making process in design, solution development and code review;
- Working in an international distributed team;
- Communicate with CTO, Architect, PM, software developers, data engineers, automation QA’s and other colleagues and stakeholders;
- Delivering the product roadmap and plannings, create estimations.

**What We Offer**
**Exciting Projects:** Come take your place at the forefront of digital transformation! With clients across all industries and sectors, we offer an opportunity to participate in creating market-defining products using the latest technologies.

**Collaborative Environment:** Expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment — or even abroad in one of our global centers or client facilities!

**Work-Life Balance:** GlobalLogic prioritizes work-life balance, which is why we offer flexible opportunities and options.

**Professional Development:** Our dedicated Learning & Development team regularly organizes certification and technical / soft skill training to help you realize your professional goals.

**Excellent Benefits:** We provide our consultants with competitive compensation and benefits

**Fun Perks:** We want you to love where you work, which is why we host sports classes, cultural, social and team building activities such as sports competitions and end-of-year corporate parties. Our vibrant offices also include dedicated GL Zones and rooftop decks where you can drink coffee or tea with your colleagues over a game of table football or darts!