Position: Data Platform Lead Engineer
Company: ITernal Group
Experience required: 5y
Category: Python
English level: upper
Published: 2022-11-01T00:00:00+02:00

Our client is seeking a Data Platform Lead Engineer to design, implement and operate on-prem and cloud Big Data platforms that support AI/ML technologies, statistics-based machine learning & deep learning models and visualization & reporting.

The platform implements capabilities such as client engagement, fraud and risk management, financial products such as bank deposits, mortgage and retail lending. Candidates should have experience with several (not all) of the technologies/tools/platforms mentioned below. The successful candidate will have the opportunity to drive the evolution of the platform and grow the team that builds it.

**You will:**
• Working with infrastructure and other Tech partners for the ongoing development, deployment and production support of the AI/ML solutions
• Work closely with members of WM analytics, Modeling and data sciences teams to:
- design, develop and implement AI/ML systems, tools and services on-premises and in the cloud
- design, develop and implement large statistical databases in DataIKU/Hadoop and DataBricks/Snowflake environments
- implement statistical and econometric models in Python/PySpark/R on the DataIKU and DataBricks platforms
- facilitate processing large data in Hadoop and Snowflake environments using Spark/PySpark/RSpark
• Ensure data integrity through – data quality, validation, governance and transparency
• Production deployment and model monitoring to ensure stable performance and adherence to standards #LI-FT1

**QUALIFICATIONS
You have:**
• Experience in developing and implementing statistical models in Big Data ecosystem, i.e., Hadoop, Spark, HBase, Hive / Impala or any other similar distributed computing technology as well as public cloud platform & systems
• Proficiency with Python/R and basic libraries for statistical/econometric modeling such as Scikit-learn, Pandas
• Experienced in Hadoop, Snowflake, Spark, HDFS, Python, R, PySpark
• Proficiency with DataIku, DataBricks or similar AI/ML tools.
• Proficiency in data analysis using complex and optimized SQL and/or the above-mentioned technologies
• Understanding of data structures, data modeling and software architecture
• Good written and verbal communication skills

**Nice to have:**
• In-depth understanding of Statistics and Mathematics
• Finance, Mortgages, Bank Deposit Products

**We Offer:**
• To work with some of the best professionals in the business - for a firm that values individual intellect as much as teamwork
• State-of-the-art offices in the City Centre that are designed to maximize collaboration
• Flexible working arrangements (core hours and opportunity to work from home)
• Enriching challenges that provide opportunity for constant learning and advancement
• An environment which is leveraging technology to its highest potential