Position: Principal or Senior Big Data Engineer
Company: GlobalLogic
Experience required: 5y
Category: Python
English level: upper
Published: 2022-09-01T00:00:00+03:00

We are looking for innovative and passionate developers who want to take ownership of features and projects and collaborate with other developers and product managers to evaluate, design, and implement from top to bottom. We will provide opportunities to work with cutting-edge technology that helps millions of people save money.

We are seeking for creative and motivated engineers to work on our digital coupon solution. There are a wide variety of challenges that have been and still need to be solved. You will have opportunities for growth and development. You will be part of a team that works on services that have saved over 1 billion coupons.

Project for customer base in the U.S. shaping the ways CPG brands operate in the market. Work with us using the latest technology and influence the way over 50 million shoppers act each day. 

The mission of the Analytics Architecture team is to enable analytics at scale.  We do this by making sure the Analytics and Data Science teams have the necessary Cloud Infrastructure, Tools, and Data to execute their research and development of machine learning/AI models.   We then work to implement these models into the larger technology infrastructure.  The team is the link between the Analytics business mission, strategy, and processes of the organization to its IT strategy. The team is unique in its capability as a bridge between Analytics and technology, having a good understanding of analytics’ unique needs and tech stack, tools, etc.

**Requirements:**
Recent experience in hands-on software development
Experienced in software for distributed production systems
Master's degree a computer science or related field
8 years of overall work experience
4+ years of experience with some of the Big Data technologies (Spark (Scala/Python), Azure Cloud, Hadoop)
Experience in scaling spark applications, optimizations and performance tuning
Expert knowledge of distributed computing, RDD and optimization techniques
Knowledgeable in Warehouse solutions (ex. Yellowbrick, Snowflake
Experience in work automation.
Process mapping experience
Proven proficiency with data analysis and ability to troubleshoot data issues
5+ years of experience with Linux/Unix Systems, and scripting.
Experience of software engineering in Python/Scala
Experiences using dev ops tools (ex. Jenkins, Azure Dev Ops)
Able to develop/unit test and deploy complex data & analytic solutions
Able to mentor fellow co-workers to expand overall team skills.
Advanced communication skills to present solutions clearly to the team and users.
Working knowledge of Agile software engineering processes.
Community developer presence (GitHub, apache, open source projects, etc)
Positive attitude towards challenges.

**Responsibilities:**
Design, Develop, Deploy and Maintain solutions in Big Data technologies (Hadoop, Azure Cloud, Hive, Databricks, Spark (Scala/Python), and other open-source technologies) in 3 main areas including:
Data ingestion pipelines from diverse sources, large scale structured and unstructured data
transmission between systems (API based) of Data – organizing data being captured and organized within our systems.

A developer will actively participate in agile SCRUM ceremonies including:
Refinement, Planning, Stand-ups and Retros
Flushing out business requirements and adding acceptance criteria & tasks to User Stories
Participate in peer review code sessions to ensure the quality of code.
Clearly communicate with management on proposed solutions/challenges.
Track and resolve data issues showing creative problem-solving skills.
Lastly, responsibilities also include:
Maintaining in-depth knowledge of data ecosystem and trends; be a subject matter expert
Recommends new tools to improve the current stack and solve data needs efficiently.