Position: Strong Middle Data Engineer
Company: GlobalLogic
Experience required: 2y
Category: Data Engineer
English level: upper
Published: 2022-04-01T00:00:00+03:00

Description:

We are looking for a talented and experienced Big Data engineer for the project which is related with advertisement insertion and delivery for different platforms. Web platform is just one of them.Customer’s patented technology provides a full ecosystem (Ad Server, Custom Video Player, and Marketplace) for serving video ads.

The main responsibility will be to build infrastructre for Machine Learning framework in order to increase the conversion rate of the proposed advertisements. The customer has a huge data set which will be used to train the models.

Requirements:
- Bachelor or Master degree in Computer Science or related technical field
- 3+ years of commercial experience in data engineering
- Proficient in SQL (any variant) and at least one of NoSQL technology
- Background in data pipelining (data ingestion, storage, and distributed processing) in batch and streaming solutions
- Designing Data Lakes, Data Warehouses
- Experience with ETL tools such as Apache Airflow, KubeFlow
- Hands-on experience with event-driven messaging frameworks (e.g. RabbitMQ and Pub/Sub)
- Working knowledge of data processing tools like Apache Spark, Dask, Ray
- Experience with cloud environments: AWS, GCP
- Proficiency with Python
- Experience with Docker and Kubernetes
- Upper-Intermediate or higher level of English

Preferences:

Apache Spark, Dask, Airflow, Kubernetes, RabbitMQ

Responsibilities:
- Manage high-volume of heterogeneous data
- Design, build and launch extremely efficient and reliable data pipelines
- Data ingestion, transformation, enriching of data with new features
- Research, patterns identification and formulating insights
- End-to-end data flows checks
- Data issues investigation
- Contribute to the definition of data quality metrics
- Extension of ETL processes
- Incorporate automation wherever possible to improve access to data and analyses
- Performance optimization
- Document work, prioritize data governance, and evangelize best practices

What We Offer

Exciting Projects: Come take your place at the forefront of digital transformation! With clients across all industries and sectors, we offer an opportunity to participate in creating market-defining products using the latest technologies.

Collaborative Environment: Expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment â or even abroad in one of our global centers or client facilities!

Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible opportunities and options.

Professional Development: Our dedicated Learning & Development team regularly organizes certification and technical / soft skill training to help you realize your professional goals.

Excellent Benefits: We provide our consultants with competitive compensation and benefits

Fun Perks: We want you to love where you work, which is why we host sports classes, cultural, social and team building activities such as sports competitions and end-of-year corporate parties. Our vibrant offices also include dedicated GL Zones and rooftop decks where you can drink coffee or tea with your colleagues over a game of table football or darts!

About GlobalLogic

GlobalLogic is a full-lifecycle product development services leader that combines chip-to-cloud software engineering expertise and vertical industry experience to help our customers design, build, and deliver their next-generation products and digital experiences. We expertly integrate design, complex engineering, and agile delivery capabilities to deliver superior business outcomes for global brands in telecom, automotive, healthcare, technology, media and entertainment, manufacturing, and semiconductor industries.

Headquartered in Silicon Valley, GlobalLogic unites over 25,000 designers and engineers across the globe. Analysts like NASSCOM and Zinnov have recognized us for being a top company in our field, and we are consistently nominated as a preferred company by both global HR consulting firms and local boards. By creating an environment that is exciting and flexible, and by fostering growth through ongoing learning and development programs, we empower our consultants to achieve both their professional and personal goals.

At GlobalLogic, we make amazing products â and careers.