Position: Lead Data Engineer
Company: IT-Outstaffing
Category: Data Engineer
Experience required: 5y
English level: upper
Published: 2023-03-01T00:00:00+02:00

DESCRIPTION:
We are looking for an Lead Data Engineer to join our client’s team on a subcontract basis.

Should have:
7+ years of experience coding in SQL, Python with solid knowledge of data structures and algorithm design
Strong knowledge of DBT 
2+ years of experience working with Snowflake
1+ year of working with Databricks 
3 years of experience in Azure 
hands-on implementation experience working with a combination of the technologies like this: Spark, Kafka, SQL and NoSQL data warehouses
experience in data migration, in particular, to Snowflake cloud Data warehouse
1+ year of technical team leadership experience
Knowledge of professional software engineering best practices for the full software
Knowledge of Data Warehousing, design, implementation and optimization
Knowledge of BI reports and dashboards design and implementation
Knowledge of development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
Experience participating in an Agile software development team, e.g. SCRUM
A consistent track record of delivering exceptionally high quality software on large, complex, cross-functional projects
Demonstrated ability to learn new technologies quickly and independently
Ability to handle multiple competing priorities in a fast-paced environment
Undergraduate degree in Computer Science or Engineering from a top CS program required. Masters preferred
Experience with supporting data scientists and complex statistical use cases highly desirable
Strong interpersonal and communication skills
English - Upper-intermediate
Location – London, United Kingdom (necessity to visit office, 50/50%)

Nice to have:
Understanding of cloud infrastructure design and implementation
Experience in data science and machine learning
Experience in backend development and deployment
Experience in CI/CD configuration

Responsibilities:
Responsibilities will include technical delivery review, resolution of architecture issues and for the migration of the existing on-premises application to Snowflake platform
Contributes design, code, configurations, and documentation for components that manage data ingestion,batch processing, data extraction, transformation, and loading across multiple data storages
Owns one or more key components of the infrastructure and works to continually improve it, identifying gaps and improving the platform’s quality, robustness, maintainability, and speed
Interacts with engineering teams and ensures that solutions meet customer requirements in terms of functionality, performance, availability, scalability, and reliability
Performs development, QA, and dev-ops roles as needed to ensure total end to end responsibility of solutions
Leading small team of data engineers working on data migration for our customer

We offer:
The full-time workload on a remote basis
Start - April 3, 2023
Duration - 3+ months
Interview - internal technical interview

If you think you are the right person, we'd welcome your application!