Position: Senior Data Engineer #7098
Company: Lohika
Experience required: 5y
English level: upper

As a part of the team, a candidate's mission is an investigation of the existing analytic platform, based on Python, Apache Spark and AWS Cloud services, as well as update and support it in a long-term perspective.

MAIN TASKS AND RESPONSIBILITIES:
Take part in requirements analyzes
Identify and encourage areas for growth and improvement within the team
Interact with customer and provide technical solutions
Work with engineering, data science and product management teams to build and manage a wide variety of data sets
Identify gaps and build the tools to increase the speed of analysis
Implement new features
Update and support an existing functionality
Conduct code reviews
Drive features from conception to deployment in an agile team with continual delivery
Provide support to QA and other teams
Be technical mentor for less experienced team members

EDUCATION, SKILLS AND EXPERIENCE:
MUST HAVE:
5+ years of experience in developing software at scale
3+ years of Python commercial development experience
Mathematical and statics skills
Experience with Apache Spark (pyspark)
Strong experience with Pandas library
Strong experience with scientific tools (numpy, scipy)
Strong experience with relational database
Experience with data visualization
Unit testing experience
Think at scale, and with high availability
Can work with cross-team members on large and complex projects
Can breakdown a complex situation and come up with an elegant solution
Sufficient English level for communication (verbal & written)
Fast research and learning skills

WOULD BE A PLUS:
Technical University degree
Knowledge of ML algorithms
Experience with AWS services like EC2, S3, EMR, etc.
Experience with Mesos or Kubernetes.
Experience with Docker.
Experience with R