Position: Lead Big Data Engineer (Java+Spark)
Company: Luxoft
Category: Data Engineer
Experience required: 5y
English level: upper

Project Description:
Liquidity Reporting Technology provides technology solutions to its internal business partners for one of the most important areas of the bank, Liquidity Measurement Reporting. The team is global with locations in India, Poland, Switzerland, UK and USA and much of what we do is regulatory driven.
3 Scrum Teams in Wroclaw. Scrum Masters, BAs, Devs.

Team competencies :
1) SQL, PL SQL, Query performance tuning ,Oracle DB Administration
2) Java/Python/Scala
3) Big Data (Hive, Impala, Spark, Sqoop)
4) Informatica Powercenter
5) Control M
6) Linux
Responsibilities:
1) Ownership and accountability for the assigned team and deliverables through all phases of the development lifecycle.
2) Complex business logic and challenging tasks for implementation.
3) High analytical and communication skills are required to make a delivery
4) Agile setup and as a result working in fast changing environment
Mandatory Skills Description:
• 6+ years of overall post-college working experience as a developer in building regulatory reporting, data warehousing, Datamart applications.
• 2+ years of knowledge of Javawith hands on experience Apache Hadoop, Spark, Impala , Sqoop, Hive, MapR and preferably Certified Bigdata Developer . Good to have some DB level knowledge (Oracle)
• Writing ETL codes for data warehouse batch job processing using Javawith Spark, hive.
• Understanding and background of distributed data processing and knowledge of batch and real-time processing. Including functional background from the systems of regulatory reporting and financial accounting
• Experience of developing software for a large enterprise, including n-tier development
• Ability to engage with collaborators to capture detailed, specific, accurate, unambiguous business requirements. Experience of writing/working with Technical Specifications, FRDs
• Good understanding of the software development lifecycle, agile practices and software development team management practices..
Nice-to-Have Skills:
• Experience as team lead/lead developer
• Banking experience
• Certified Bigdata Developer
• Scala
• Python