Position: Big Data Engineer
Company: Luxoft
Experience required: 5y
Category: Java
English level: upper
Published: 2021-05-01T00:00:00+03:00

Our consultants provide the advice and support clients need to transform and manage their Big Data initiative and start unlocking the valuable business opportunities. Clients benefit from Big Data and enhanced analytics to improve customer engagement and satisfaction, create new business opportunities and reduce costs.

The pace of business is accelerating. Consumers know it because the world is now literally at their fingertips — they no longer have to wait to receive the latest products and services. DXC offers are managing big data solutions and platforms to enable our customers to develop the fully autonomous driving of our future and to deliver the kind of business agility you need to swiftly adapt to the speed of the marketplace.

The Big Data Engineer is part of the WW offering build team. (S)He works with respective automotive accounts, Hadoop experts, experienced software developers, data scientists and technology experts to deliver analytic solutions for our customers.

Responsibilities
• Meta data management feature development for autonomous driving to provide meaning to the data though search, discovery, extraction, enrichment, storage
• Distributed, scalable meta data store for managing and serving automotive metadata pertaining to content levels (e.g. attributes, sensor header, message header, sentence)
• Self-discovery, auto-generation, auto-population of metadata for every automotive file on Data Lake) as a post-ingestion process
• Build standard APIs, user defined functions and serving layer for programmable exploration, analysis and integration of metadata into AD pipes at PB scale
• User Interface for ad hoc / interactive search in real time
• Integration with Data Lifecycle Management to execute data lifecycles through data copy, deletion, mirroring, tiering based on defined meta data attributes
• Performance benchmarking on bare metal, cloud and hybrid ecosystems
• Contribute as technical expert in presales activities and knowledge sharing in autonomous driving community

Skills
Must have
• Bachelor or Master degree required in informatics, business informatics, business administration or equivalent qualification
• Languages: English (fluent)
• Proven experience in distributed systems, e.g. Big Data or micro services
• Minimum 3+ years of experience as Big Data developer (Java, Python, Spark)
• Experience with/understanding of NoSQL (Elasticsearch preferably) storages
• Strong algorithmic understanding
• Hands-on experience with container platform administration and/or container application development (e.g. RedHat OpenShift, Kubernetes, AWS, Docker) (2+ years)
• Know-how in pipeline build and infrastructure code automation; CI/CD e.g. Jenkins, Azure Pipelines (2+ years)
• Hands-on experience data visualization (Kibana, Zeppelin)
• Strong customer focus, assertiveness and precise method of operation
• Possesses an understanding of architectural dependencies of technologies in the customer's analytic environments
• Able to communicate and present internally and externally in a confident manner 

Nice to have
• Elasticsearch