Position: Senior Databricks Engineer for Ciklum Digital
Company: Ciklum
Experience required: 3y
Category: Data Engineer
English level: upper
Published: 2022-02-01T00:00:00+02:00

Project Description:

Client is a German subscription-based language learning app and e-learning platform, available in various languages since January 2008.The language learning platform went online with community features as a free beta version in 2008. 

Product Description: 

Product is a subscription-based language learning app for web, iOS and Android. Product currently offers 15 different languages from seven display languages.
There are beginner, intermediate and grammar courses, vocabulary lessons, as well as courses with tongue-twisters, idioms, colloquialisms, and sayings. Courses for a given language may be aimed at a specific audience: for instance, English may be learned as "PR English" or "Marketing English."

Technology Stack: Databricks, DynamoDB, Kinesis, AWS

Responsibilities:

- Responsible for the building, deployment, and maintenance of mission-critical analytics solutions that process terabytes of data quickly
- Contributes to design, code, configurations, manage data ingestion, real-time streaming, batch processing, ETL across multiple data storages
- Performs development, QA, and dev-ops roles as needed to ensure total end-to-end responsibility of solutions
- Responsible for performance tuning of complicated SQL queries and architecture and tuning of NoSQL implementations and Data flows
Identify gaps and improving the platform’s quality, robustness, maintainability, and speed
- Cross-trains other team members on technologies being developed, while also continuously learning new technologies from other team members

Requirements:

- 3+ years of experience coding in Python, SQL with solid CS fundamentals including data structure and algorithm design
- 2+ years contributing to production deployments of large backend data processing and analysis systems 
- 1+ years of hands-on implementation experience working with a combination of the following technologies: Spark, Kinesis, DynamoDB, NoSQL and NoSQL data-warehouses such as Hbase and Cassandra
- 1+ years of experience in cloud data platforms – AWS, or other 
- Hands-on experience with Databricks
- Upper-Intermediate or Advanced English