Position: Senior BigData Engineer #7602
Company: Lohika
Category: Python
Experience required: 5y
English level: upper
Published: 2020-09-01T00:00:00+03:00

MAIN TASKS AND RESPONSIBILITIES:
Design, develop, deliver and operate scalable, high-performance data processing software.
Work proactively on the system architecture.
Ensure high quality development standards (unit/integration tests, etc.)
Collaboration with the product management team to incorporate the needs of our customers.
EDUCATION, SKILLS AND EXPERIENCE:
MUST HAVE:
5+ years with BigData technologies and tools.
3+ years of Python development experience (Python, PySpark)
Strong hands-on experience with Spark
Handling scalability issues, pipeline/cluster optimization
Experience with AWS
Good English (oral & written) and communication skills in general
WOULD BE A PLUS:
Pandas, Databricks/koalas.
DevOps experience for Big Data solutions.