Position: Middle Big Data Engineer for Ciklum Digital
Company: Ciklum
Experience required: 2y
Category: Scala
English level: intermediate
Published: 2020-09-01T00:00:00+03:00

As Ciklum employee, you'll have the unique possibility to communicate directly with the client when working in Extended Teams. Besides, Ciklum is the place to make your tech ideas tangible. The Vital Signs Monitor for the Children’s Cardiac Center as well as Smart Defibrillator, the winner of the US IoT World Hackathon, are among the cool things Ciklumers have developed.

Ciklum is a technology partner for Google, Intel, Micron, and hundreds of world-known companies. We are looking forward to seeing you as a part of our team!

Description

On behalf of Ciklum Digital, Ciklum is looking for a Middle Big Data Engineer to join the Ukrainian team on a full-time basis.

You will join a highly motivated team and will be working on a modern e-commerce solution for our existing client. We are looking for technology experts who want to make an impact on new business by applying best practices and taking ownership.

About the Project:

This interesting and challenging initiative involves designing, implementing and maintaining a complex Intelligence platform capable of processing multipart Big Data from various established vendors, managing such data in its totality to produce meaningful real-life investment-grade, event-signals for a leading US based private equity investor with focus in high-tech industry with portfolio that stretches across the globe. Ciklum has been actively and successfully involved in building and maintaining this AWS based product for over three years and is the lead systems integrator for the intelligent, predictive decision-making process and technology of the entire end-to-end marketing and decision-science platform that includes data ingestion, cleansing, standardizing, codifying, co-relating and making predictive decisions based on heuristic analytical models.

Responsibilities
- Back End Python and/or Scala development; Java experience would be an advantage
- Implementing DWH architecture
- Implementing ETL process, workload with Lambda/Kappa implementations with data streaming
- Monitoring performance and advising any necessary infrastructure changes

Requirements

You can name examples of use in different contexts. Are guided by best-practices and specifications of such skills:

General:
- Python experience 3+ years or Scala 2+ years with Java 3+ years
- Understand problems with distributed algorithms and data structures
- Understand and handle multiprocessing, concurrency and parallelism
- Experienced/advanced Linux user
- Experience with one of AWS, GCP, Azure
- ETL or streaming experience on one of named clouds
- Experience with DWH
- Experience with Data Lakes
- Proficient understanding of distributed computing principles
- Experience with building stream-processing systems which use Kafka, Apache Spark Streaming, Akka Streams, Kafka Streams, Storm, RabbitMQ or other
- ETL implementation based on Hadoop/Spark stack and/or Presto, Hive, etc.
- Experience with NoSQL databases, such as HBase
- Experience with RDBMS’s like Oracle, PostgreSQL and MySQL

Optional:
- Graduate in quantitative scientific, engineering and/or mathematical discipline ((Mathematics generally, Statistics/Probability, Physics, Electrical Engineering, Experimental Psychology, Chemistry, etc.) –– demonstrable deep knowledge in quantitative principles
- Significant experience working closely with business subject matter experts (SME) to achieve business outcomes
- Comfortable with travel when needed
- Very entrepreneurial by nature, experience in startup culture
- Ready for intensive self-education as a must

Personal skills
- Curious mind and willingness to work with client in consultivitive manner to find areas to improve
- Intermediate +++ English
- Good analytical skills
- Good team player, motivated to develop and solve complex tasks
- Self-motivated, self-disciplined and result-oriented
- Strong attention to details and accuracy

What's in it for you
- Close cooperation with client
- Constant flow of new projects
- Dynamic and challenging tasks
- Ability to influence project technologies
- Projects from scratch
- Team of professionals: learn from colleagues and gain recognition of your skills
- European management style
- Continuous self-improvement