Position: Lead Spark Big Data Developer
Company: Luxoft
Category: Python
Experience required: 3y
English level: fluent
Published: 2020-03-01T00:00:00+02:00

There are millions of cars on the road today with solutions designed & implemented by us focusing on Autonomous Drive, Embedded Applications, Digital Cockpit, Connected Mobility & overall excellence in delivery.

Software inside vehicles used to be a self-contained environment. Equipping cars with perception, intelligence & connecting them changed a lot for the vehicle manufacturer. Our goal is to empower our customers with smart solutions to help them develop the cars of the future.

**About the Project:**
The Big Data Developer is part of the WW offering build team. (S)He works with respective automotive accounts, Hadoop experts, experienced software developers, data scientists and technology experts to deliver analytic solutions for our customers.

The goal of the program is to solve the 'billion-mile validation challenge' by providing end-to-end features and service for Level 3+ Autonomous Driving software development and validation that can be deployed as a collaboration eco-system accessible to the automotive market worldwide.

**Responsibilities:**
Agile feature development in fully automated labeling for DXC autonomous driving for fully automated generated "Ground-Truth-Equal" labels on a Robotic-Drive-cluster-level/dimension scale for verifying higher SAE levels of Autonomy with the growing data volumes
• Implement fully automated labeling of objects as part of ingest pre-processing pipeline
• Save labels into Pascal and automotive formats (e.g. ROSbag, MDF4)
• State-of-the art data science user Interface for ad hoc / interactive analytics of created annotations at PB scale
• Implement standard APIs for user defined functions and annotations
• Integration into Machine Learning DevOps pipeline, meta data store and model repositories
• Develop analyzer features, proof-of-concept and demos in support of presales activities for clients
• Contribute as technical expert in presales activities

**Mandatory Skills:**
• Bachelor or Master degree required in informatics, business informatics, business administration or equivalent qualification
• Languages: English (fluent)
• Minimum 3+ years of experience as Big Data developer (in Spark, PySpark)
• Demonstrated know-how in Spark architecture
• 3+ years lead software developer
• Big Data Programming know-how in Java and Python
• Exposure to containerization and workflow scheduling (Docker, Kubernetes, Airflow)
• 1-year experience in Machine Learning DevOps (Pytorch, Tensorflow)
• Possesses an understanding of architectural dependencies of technologies in the customer's analytic environments
• Able to communicate and present internally and externally in a confident manner

**Nice-to-Have Skills:**
• Hands-on of experience with native reading, writing and processing of automotive formats (e.g. ROSbag, MDF4)
• Experience in cloud (Azure/AWS)