Position: Expert Data Engineer for Ciklum Digital
Company: Ciklum
Experience required: 5y
Category: Lead
English level: upper
Published: 2020-09-01T00:00:00+03:00

**Description**
On behalf of Ciklum Digital, we are looking for an Expert Data Engineer to join a highly motivates UA team on a full-time basis. We are looking for technology experts who want to make an impact on new business by applying best practices and taking ownership.

**Project description**:
Client is building the next generation global on-demand delivery platform. The company has grown rapidly from inception in 2011 to become the world’s largest food-ordering network and now innovating and creating new verticals. An awesome international team already operates in 40+ countries worldwide and we are looking for the most talented people to join on a mission to always deliver an amazing experience.
Client founded as one of the first online food ordering portals in the region, today is the food delivery platform leader in Saudi Arabia with more than 100,000 orders per day and millions of happy customers every month.

**Responsibilities**
- Focus on Goals/Delivery – ability to internalize a long/medium term vision and motivate a team to work towards goals.
- Development & testing of new data pipelines/integrations/processes (involve programming)
- Maintenance of existing data systems (data warehouse, data pipelines, integrations, etc.)
- Sanity checks of data systems, and data quality, consistency & accuracy checks
- Performance tuning of existing data processes and pipelines
- Collecting & preparing data as per the Ad-hoc reporting/analytics requests
- Responsibility upon building, deployment, and maintenance of mission critical analytics solutions that process data quickly at big data scales
- Contribute design, code, configurations, and documentation for components that manage data ingestion, real time streaming, batch processing, data extraction, transformation and
loading across multiple data storages.
- Own one or more key components of the infrastructure and work to continually improve it, identifying gaps and improving the platform’s quality, robustness, maintainability and speed.
-  Share knowledge other team members on technologies being developed, while also continuously learn new technologies from other team members.
- Interact with engineering teams and ensure that solutions meet customer requirements in terms of functionality, performance, availability, scalability, and reliability.
- Perform development, QA, and dev-ops roles as needed to ensure total end to end responsibility of solutions.
- Contribute to CoE activities and community building, participate in conferences, provide excellence in exercise and best practices.

**Requirements**
- 6+ years of experience in a Data Engineering role.
- 3+ years of experience coding in SQL and any of Java, Python, C# or Scala, with solid CS fundamentals including data structure and algorithm design (with focus on distributed systems)
- 1+ years of hands-on implementation experience working with a combination of the following technologies:Hadoop, Map Reduce, Pig, Hive, Impala, Spark, Kafka, Storm, Presto, SQL and NoSQL data warehouses such as Hbase and Cassandra.
- Relational databases like Postgres, Mysql, Redshift, etc (advanced SQL writing and optimization skills are required)
- 1+ years of experience in cloud data platforms (AWS, GCP)
- Cloud Data Warehouses like AWS Redshift or Google Bigquery
- Engineering excellence – a proven track record of substantially impacting the development of complex distributed data pipelines and databases.
- Knowledge of containerization technologies like Kubernetes/Dockers
- Experience with Linux and shell scripting
- Knowledge of SQL and MPP databases (e.g. Vertica, Netezza, Greenplum, Aster Data)
- Knowledge of professional software engineering best practices for the full software
- Knowledge of Data Warehousing, design, implementation and optimization
- Knowledge of Data Quality testing, automation and results visualization
- Knowledge of development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
- Experience participating in an Agile software development team, e.g. SCRUM
- Experience designing, documenting, and defending designs for key components in large distributed computing systems
- A consistent track record of delivering exceptionally high quality software on large, complex, cross-functional projects
- Demonstrated ability to learn new technologies quickly and independently
- Ability to handle multiple competing priorities in a fast-paced environment
- Undergraduate degree in Computer Science or Engineering from a top CS program required. Masters preferred.