Position: Senior Data Engineer #1054
Company: Lohika
Category: Data Science
Experience required: 3y
English level: upper
Published: 2022-01-01T00:00:00+02:00

Lohika company provides premium software engineering services to leading technology companies. Our customer is a global health care company. Our application is a predictive patients enrollment tracking and simulation tool enabling clinical trial teams to create and edit enrollment plan scenarios, add, edit and compare scenario assumptions and track study actuals against the approved plan.
  
Responsibilities
End-to-end data flows checks
Data issues investigation
Data transfer maintenance
Improvement of existing dataflow process
Adopt/re-use computation logic from pipelines written on Scala to technologies used on project
Direct communication with stakeholders and colleagues from customer side

Required Knowledge
Strong Python skills
Pyspark strong skills, Pandas
Testing frameworks (e.g., pytest)
Strong SQL scripting skills
Git
Apache Airflow and/or other workflow frameworks
Upper-Intermediate level of English

Optional Knowledge
Experience with Scala
Bash/Shell scripting
Docker
Python Packaging