Position: Senior Data Engineer for Ciklum
Company: Ciklum
Experience required: 3y
English level: upper

On behalf of Data & Analytics Ciklum is looking for a Senior Data Engineer to join our team on a full-time basis.

You will join a highly motivated team and will be working on a modern solution for our existing client. We are looking for technology experts who want to make an impact on new businesses by applying best practices and taking ownership.

Project description:

The client is a Tech company - Technology is the driver, e-commerce is the outcome. It was established in 2010 to provide a seamless e-commerce experience to customers and SMEs. In ten years, the project became the largest e-commerce company in Turkey, as well as one of the leading global platforms. Our Client is the 1st Turkish company to achieve the decacorn status and the most valuable private internet company in the EMEA region.
The business is scaling fast and profitably, expanding into international markets.

Client`s culture is at the core of everything it does. Focused on results, keeping customers first, teams always work for better and always test, iterate and improve. Learning from mistakes, direct and open feedback is at the core of the culture. If you want to learn, grow and deliver; are result-oriented, love teamwork, appreciate open communication, learning, and iteration, and make decisions with data, Come, join!

Technology Department is one of the most important teams at our Client`s company which is a future-oriented, fast-growing, and technology enthusiast company. Software Development Team builds scalable, high-performing platforms for customer satisfaction by using up-to-date and efficient technologies.

Technology Stack: Kafka, Spark, Flink, Airflow, Sql, Hive, Git, SBT, Kubernetes, Docker, Spring Boot, Alibaba Cloud, Amazon Web Services, Jupyter, Zeppelin, Cassandra, Akka
Languages: Scala, Java, SQL

Responsibilities:
● Contributes to design, code, configurations, and documentation for components that manage data ingestion, real-time streaming, batch processing, data extraction, transformation, and loading across multiple data storages.
● Owns one or more key components of the infrastructure and works to continually improve it, identifying gaps and improving the platform’s quality, robustness, maintainability, and speed.
● Interacts with engineering teams and ensures that solutions meet customer requirements in terms of functionality, performance, availability, scalability, and reliability.
● Performs development, QA, and dev-ops roles as needed to ensure total end-to-end responsibility of solutions.
● Building infrastructure to support real-time or offline data pipelines for processing terabytes of data,
● Design and scale data ingestion systems with high availability and reliability,
● Creating and managing data jobs with various data platforms,
● Data enrichment and manipulation on streaming data,
● Developing and designing R&D Projects,
● Provide architectural support by building PoC & Prototypes


Requirements:

● Degree in Computer Engineering, Electronics Engineering, Mathematical Engineering, Mathematics, and related Information Technologies,
● 5 years experience in related areas,
● Hands-on experience in building data pipelines with Spark or Flink
● Experience in open-source data technologies (Hadoop, Hbase, Hive, Kafka, Storm, etc.) is a plus,
● Knowledge of streaming architecture is a big plus,
● Strong object-oriented design and development skills,
● Experience with Unix/ Linux and shell scripting,
● Hands-on with Java/Scala programming,
● Experience with SQL and NoSQL technologies, data modeling and tradeoffs,
● Experience with databases columnar, distributed, row-based,
● Enjoy doing research and able to gather information to find out and execute best practices of the areas he/she is responsible for,
● Enjoy improving & optimizing software and using new technologies


Desirable (Hard skills):
● Experience building RESTful APIs
● Experience in backend development and deployment
● Experience in CI/CD configuration


Personal skills (soft skills):
● Collaborative, willing to help, talkative, able to clearly express and discuss ideas
● Curious mind and willingness to work with a client in a consultative manner to find areas to improve;
● Upper-Intermediate;
● Good analytical skills;
● Good team player motivated to develop and solve complex tasks;
● Self-motivated, self-disciplined, and result-oriented;
● Strong attention to details and accuracy.