Position: Data Engineer
Company: PSR Company
Experience required: 3y
Category: Data Engineer
English level: upper
Published: 2022-02-01T00:00:00+02:00

Duties Description

Solve challenging problems in a fast-paced and evolving environment while maintaining uncompromising quality.
Contribute to the core design of data architecture, data models and schemas, and implementation plan. 
Design, build and maintain optimal data pipeline architecture for extraction, transformation, and loading of data from a wide variety of data sources, including external APIs, data streams, and data stores. 
Design, build and maintain the infrastructure for ingesting data into our data lake and data warehouse and providing frameworks and services for operating on that data. 
Design, build and maintain the infrastructure for real-time streaming analytics, big data analytics, and machine learning analytics capabilities. 
Implement data privacy and data security requirements to ensure solutions stay compliant with security standards and frameworks.
Enhance the team's dev-ops capabilities.
Must have:

Bsc in CS/Mathematics/Statistics/Physics/EE or equivalent experience.
2+ years of proven experience developing large-scale software using an object-oriented or a functional language.
Proven experience with cloud-based data pipeline/backend services, using AWS.
Proficient with relational and non-relational data modeling. 
Familiarity with a variety of big data frameworks and tools, including EMR (AWS Spark), Athena (AWS Presto), Glue, Data Orchestration, etc. 
High-level English - a must. 
A team player with excellent collaboration skills.
Nice to Have:

Experience with containerized (Docker, ECS, Kubernetes) or serverless (Lambda) deployment. 
Experience with Airflow
Experience with Data Lineage 
knowledge of Spark internals (tuning, query optimization)