Position: Senior Data Engineer for Ciklum Client
Company: Ciklum
Category: Data Engineer
Experience required: 3y
English level: intermediate
Published: 2023-01-01T00:00:00+02:00

As a Senior Data Engineer you will join a highly motivated team and will be working on a modern solution for our existing client. 

Tech stack: Azure, Data Lake, Azure Functions, Azure Eventhub,Azure DevOps, Azure SQL database

**About the Project:**
At present, the main project’s goals are developing a new architecture designed for streaming near real time data based on the Azure environment and maintaining an existing Confluent Cloud Kafka and Kubernetes (AKS) infrastructure. The team consists of a single Senior Data Engineer and two Senior DevOps. The Board being utilized is Kanban which in combination with Scrum framework ceremonies helps the project with usability, visibility as well as continuous delivery.

**Responsibilities**
- Responsible for the building, deployment, and maintenance of mission critical analytics solutions that process data quickly at big data scales
- Contributes design, code, configurations, and documentation for components that manage data ingestion, real time streaming, batch processing, data extraction, transformation, and loading across multiple data storages
- Owns one or more key components of the infrastructure and works to continually improve it, identifying gaps and improving the platform’s quality, robustness, maintainability, and speed
- Cross-trains other team members on technologies being developed, while also continuously learning new technologies from other team members
- Interacts with engineering teams and ensures that solutions meet customer requirements in terms of functionality, performance, availability, scalability, and reliability
- Performs development as well as basic QA, and dev-ops roles as needed to ensure total end to end responsibility of solutions
- Contribute in CoE activities and community building, participate in conferences, provide excellence in exercise and best practices

**Requirements**
- knowledge of one coding languages (Python/C#/Java)
- Azure Data Lake, Azure DatabricksAzure DevOps, Azure Functions, Azure Eventhub (especially Kafka enabled), Azure Synapse, Azure SQL DB
- Knowledge of Data Warehousing, design, implementation and optimization
- Knowledge of Data Quality testing, automation and results visualization

**What's in it for you**
- Care: your mental and physical health is our priority. We ensure comprehensive company-paid medical insurance, Mental Health programs, as well as financial and legal consultations
- Tailored education path: boost your skills and knowledge with our regular internal events (meetups, conferences, workshops), Udemy licence, language courses and company-paid certifications
- Growth environment: share your experience and level up your expertise with a community of skilled professionals, locally and globally
- Flexibility: choose how you want to work – a 100% remote or on-sight in our offices. Own your schedule – you are the one to decide when to start your working day. 
- Opportunities: we value our specialists and always find the best options for them. Our Internal Mobility Program helps change a project if needed to help you grow, excel professionally and fulfil your potential
- Global impact: work on large-scale projects that redefine industries with international and fast-growing clients
- Welcoming environment: feel empowered with a friendly team, open-door policy, informal atmosphere within the company and regular team-building events