Position: Lead BigData Developer (Python, Spark, AWS)
Company: Grid Dynamics
Experience required: 5y
Category: Python
English level: upper
Published: 2021-08-01T00:00:00+03:00

Our client’s Engineering, Data, Product and Security teams are located in Berlin and New York and are critical to what we do. From procurement tools to conversion rate optimization, live pricing tools, payment services and add-on upselling features, they work on a wide variety of challenging problems. The result is a high output where they constantly build and release features and engines that make the business thrive, allowing them to deliver real financial impact.

As a Lead Data Engineer, you will be responsible for spreading best data engineering practices within the organization and in the team. You will support us in designing, building, and maintaining our data infrastructure, with special focus on flexibility and scalability. You will have the opportunity to work on challenging data-related problems and to have a great impact on the organization.

**Responsibilities:**
Defining standard working methods and processes to be respected by all chapter members, best practices in developing data pipelines, data architectures, testing, and deploying changes, documentation standards
Enabling quick and accurate decision-making within the teams by facilitating discussions
Creating and coordinating communities
Coaching and mentoring data engineers in order to support their growth
Setting and spreading best practices for Data Engineering across the organization
Providing solutions for complex business problems, enabling insights that can empower better decision-making
Collaborating with the Director of Data Engineering on strategic projects on the client's side

**Required skills:**
Extensive working experience with Kafka, the Hadoop Ecosystem (Hadoop, Kafka, Spark), with cloud based services (AWS S3, EMR, Glue) and with containers (Docker, Kubernetes, ECS, EKS).
Ability to bring hands-on experience in creating and managing an enterprise-scale Data Platform, while setting best practices for security, privacy, monitoring & alerting, and CI/CD (ideally, e.g., Azure, Prometheus, AlertManager, Grafana, Jenkins, Concourse, Airflow, Tableau, Alation)
Expertise in coaching and mentorship team members
Ability to  leverage data to prioritize your work and to influence others
Expertise in senior stakeholders management in complex organizations and in changing environments
Willing to implement change and improvements when seeing an opportunity

**We offer:**
Opportunity to work on bleeding-edge projects
Work with a highly motivated and dedicated team
Competitive salary
Flexible schedule
Medical insurance
Benefits program
Corporate social events