Position: Big Data Engineer
Company: Epam
Experience required: 2y
Category: Data Science
English level: intermediate
Published: 2022-01-01T00:00:00+02:00

DESCRIPTION

As a Senior Big Data Engineer, you will live on the front lines of the products we create, and build features used by millions of people every day.

Our project is about migrating data from several sources: PostgresDB, MongoDB, AWS Cloud Watch and Salesforce to Google Cloud Platform (GCP). The main goal is to develop a generic platform for future integration in various regions, now focus on the UK region. And the final goal is to provide the ability to create specific custom reports and analytics for users.

PROJECT TECHNOLOGIES AND TOOLS
Cloud Storage (GCS)
BigQuery
DataFlow
Apache Beam SDK (Java 8)
Cloud Composer / Apache Airflow
FireBase
Looker (analog of Tableau)
Other GCP services used in the project: Cloud Load Balancing, Compute Engine, Cloud FireStore, Data Loss, Cloud IAM, Monitoring, Key Management Service, Error Reporting, Loggin

RESPONSIBILITIES
Customer communication
Solution architecture design
Feature development
PoC development
Requirements clarification
Other interaction with the customer development team

REQUIREMENTS
3+ years of experience in Java or Python
Experience with HIVE, Spark will be a plus
Experience with Apache Hadoop will be a plus
Strong communication skills
Good spoken and written English

**WE OFFER**
Competitive compensation depending on experience and skills
Individual career path
Unlimited access to LinkedIn learning solutions
Social package - medical insurance, sports
Compensation for sick lists and regular vacations
English classes with native speakers (certified English teachers)
Flexible work hours