Position: Big Data engineer
Company: GlobalLogic
Experience required: 3y
Category: Python
English level: upper
Published: 2021-01-01T00:00:00+02:00

In this role, you will build and expand upon the data science models testing framework and testing infrastructure of our core ad verification, analytics, and anti-ad fraud software products. The ideal candidate is naturally curious, dedicated, detailed-oriented with a strong desire to work with awesome people in a highly collaborative environment.

**Requirements**
- 2+ years of production experience on Big Data projects
- 1+ years of recent hands-on Python experience
- Strong knowledge of Airflow
- AWS experience, especially with EMR, CDK
- Great understanding of designing for performance, scalability, and reliability
- Superb understanding of algorithms, scalability, and various tradeoffs in a Big Data setting
- Experience with Spark and Hadoop
- In-depth understanding of object-oriented programming concepts
- Excellent interpersonal and communication skills
- Understanding of full software development life cycle, agile development, and continuous integration
- Good knowledge of Linux command-line tools
- Solid understanding of database fundamentals, good knowledge of SQL
- Bonus points:
         – Experience with Pig and Hive

**Responsibilities**
- Working on Big Data technologies such as Airflow, Spark, Amazon EMR
- Architect, design, code and maintain components for aggregating tens of billions of daily transactions
- Migrating services from on-prem to Cloud
- Lead the entire software lifecycle including hands-on development, code reviews, testing, deployment, and documentation for streaming and batch ETL’s and RESTful API’s
- Mentor junior team members