Position: Middle Big Data Engineer for Ciklum Digital
Company: Ciklum
Experience required: 3y
Category: Scala
English level: intermediate
Published: 2021-02-01T00:00:00+02:00

On behalf of Ciklum Digital, Ciklum is looking for a Middle Big Data Engineer to join the Ukrainian team on a full-time basis.

You will join a highly motivated team and will be working on a modern e-commerce solution for our existing client. We are looking for technology experts who want to make an impact on new business by applying best practices and taking ownership.

About Project:
This interesting and challenging initiative involves designing, implementing and maintaining a complex Intelligence platform capable of processing multipart Big Data from various established vendors, managing such data in its totality to produce meaningful real-life investment-grade, event-signals for a leading US based private equity investor with focus in high-tech industry with portfolio that stretches across the globe. Ciklum has been actively and successfully involved in building and maintaining this AWS based product for over three years and is the lead systems integrator for the intelligent, predictive decision-making process and technology of the entire end-to-end marketing and decision-science platform that includes data ingestion, cleansing, standardizing, codifying, co-relating and making predictive decisions based on heuristic analytical models.

Responsibilities:
- Backend Python and/or Scala development
- Implementing DWH architecture
- Implementing ETL process, workload with Lambda/Kappa implementations with data streaming
- Monitoring performance and advising any necessary infrastructure changes

Requirements:
You can name examples of use in different contexts. Are guided by best-practices and specifications of such skills:
- Strong Python experience (3+ years) and/or Scala 2+ years
- 2+ years of experience coding in SQL
- Understand problems with distributed algorithms and data structures
- Understand and handle multiprocessing, concurrency and parallelism
- Strong skills in data modelling, DWH, and ETL building
- Proficient understanding of distributed computing principles
- Ready for intensive self-education as a must

Desirable:
- Experience with one of AWS, GCP, Azure
- Experience with building stream-processing systems which use Kafka, Apache Spark Streaming, Akka Streams, Kafka Streams, Storm, RabbitMQ or other
- ETL implementation based on Hadoop/Spark stack and/or Presto, Hive, etc..
- Experience with NoSQL databases, such as HBase

Personal skills:
- Curious mind and willingness to work with client in consultivitive manner to find areas to improve
- Intermediate or Upper-Intermediate English
- Good analytical skills
- Good team player, motivated to develop and solve complex tasks
- Self-motivated, self-disciplined and result-oriented
- Strong attention to details and accuracy

What's in it for you:
- Close cooperation with client
- Constant flow of new projects
- Dynamic and challenging tasks
- Ability to influence project technologies
- Projects from scratch
- Team of professionals: learn from colleagues and gain recognition of your skills
- European management style
- Continuous self-improvement