Position: Big Data Engineer
Company: ITernal Group
Category: Data Engineer
Experience required: 3y
English level: upper
Published: 2023-02-01T00:00:00+02:00

UST Inc. is looking for a Big Data Engineer - Python

**Responsibilities:**
Work closely with various team to understand the data requirements. Analyze incoming data requests for team and determine appropriate target solutions. Develop data service design. Develop applications used for streaming data from data lake to data sink. Collaborate with Architects, Data Analysts and Modelers to build scalable and performant data solutions. Troubleshoot problems and optimize performance. Support ongoing data management efforts for Development, QA and Production environments. Apply best available tools & technologies for Big data applications.

**Requirements:**
• 3+ years of experience with Big Data cloud services in AWS. E.g. Elastic Map Reduce, Glue
• 3+ years of python development experience
• Hands-on experience with Apache spark and PySpark 
• Experience with AWS S3, Lambda, Athena, Cloud Watch, Cloud Logging
• Understanding of efficient data formats e.g. Parquet, Avro or similar

**Good to have:**
• Python libraries for data science, e.g. NumPy, SciPy, etc.
• Experience with data analytics
• Data science skills

**We offer:**
• Friendly professional staff and warm atmosphere;
• The environment where you can implement your ideas;
• Plans for growth and performance review;
• Flexible schedule and opportunities to work remotely (8 hours workday);
• Paid 18 days of vacation and up to 10 sick leaves annually;
• Medical insurance after the trial period;
• English courses;
• Participation in educational activities and thematic conferences;
• Attending professional conferences, summits, workshops, and seminars (70% of the cost offset by the company);
• Team parties and corporate events.