Position: Big Data Engineer
Company: GlobalLogic
Category: Data Engineer
Experience required: 3y
English level: upper
Published: 2022-06-01T00:00:00+03:00

**Job Description**
Experience with building stream-processing systems using solutions such as Apache Kafka and Apache Spark streaming
Experience with designing, implementing, and deploying in cluster data pipelines using Apache Spark framework (RDD, Dataframe, Streaming)
Experience with SQL databases and NoSQL databases, such as MongoDB
Experience of working with APIs.
Proficient understanding of microservices architecture and distributed systems
Experience with Hadoop ecosystem on-premise or on-cloud
Good level of English (read/written/spoken). Ability to take part in day-to-day communication and lead a conversation with other stakeholders.
 

**Nice to have:**

Hands-on experience with Docker, Kubernetes
Commercial experience working in a bank projects will be a plus.
 

**Job Responsibilities**

Researching, designing, and developing appropriate algorithms for Big Data collection, processing, and analysis.
Selecting and integrating any Big Data tools and frameworks required to enable new and existing product capabilities.
Collaborate closely with the product team to define the requirements and set milestones that relate to Big Data features.
Monitoring performance and advising any necessary infrastructure changes.
Closely interact with the Data Scientists in providing feature-ed datasets.
Perform other duties as deemed appropriate by the management team.