Position: Senior Spark Big Data Developer
Company: Luxoft
Experience required: 3y
Category: Data Science
English level: intermediate
Published: 2020-03-01T00:00:00+02:00

The goal of the program is to solve the 'billion-mile validation challenge' by providing end-to-end features and service for Level 3+ Autonomous Driving software development and validation that can be deployed as a collaboration eco-system accessible to the automotive market worldwide.
Responsibilities:
Agile feature development in fully automated labeling for DXC autonomous driving for fully automated generated "Ground-Truth-Equal" labels on a Robotic-Drive-cluster-level/dimension scale for verifying higher SAE levels of Autonomy with the growing data volumes
• Implement fully automated labeling of objects as part of ingest pre-processing pipeline
• Save labels into Pascal and automotive formats (e.g. ROSbag, MDF4)
• State-of-the art data science user Interface for ad hoc / interactive analytics of created annotations at PB scale
• Implement standard APIs for user defined functions and annotations
• Integration into Machine Learning DevOps pipeline, meta data store and model repositories
• Develop analyzer features, proof-of-concept and demos in support of presales activities for clients
• Contribute as technical expert in presales activities
Mandatory Skills:
• Bachelor or Master degree required in informatics, business informatics, business administration or equivalent qualification
• Languages: English (fluent)
• Minimum 3+ years of experience as Big Data developer (in Spark, PySpark)
• Demonstrated know-how in Spark architecture
• 3+ years lead software developer
• Big Data Programming know-how in Java and Python
• Exposure to containerization and workflow scheduling (Docker, Kubernetes, Airflow)
• Able to communicate and present internally and externally in a confident manner
Nice-to-Have Skills:
• Hands-on of experience with native reading, writing and processing of automotive formats (e.g. ROSbag, MDF4)
• Experience in cloud (Azure/AWS)
• Possesses an understanding of architectural dependencies of technologies in the customer's analytic environments
• 1-year experience in Machine Learning DevOps (Pytorch, Tensorflow)
Languages:
English: Advanced/Fluent