Position: Software architect (Relocation to UK)
Company: Luxoft
Experience required: 3y
English level: upper

They are taking the data feeds from 120+ front office data sources and aggregating and ensuring they report the correctly the data to number of regulatory bodies and stock exchanges as would be required. Currently the team would leverage the EAP (Enterprise Analytics Platform) to build the current application. MVP has gone live in December but major feed onboarding happening over the next 2 years.

Responsibilities:
Report into Compliance Domain Architect and Programme Manager
This is not a traditional solution architect role as many of the building blocks for our solution have already been developed
Understand how to gradually morph a code base in a controlled manner to make it performant
Adoption of existing in-house built code frameworks (Java and SparkSQL)
Know what it takes to build high quality common code components that can be re-used across programmes
Microservice architecture down to software component
Very strong communication skills to influence and direct multiple developer teams in London and Pune
Product architecture document

Mandatory Skills Description:
• Technical
o Fundamentals of Spark using the Dataframe API
o Strong understanding of how the spark engine is architected and how spark is used i.e. sparksql, pyspark, map reduce, etc.
o Strong understanding of performance techniques e.g. performance implication such as disk load, data partitioning.
o Hand-on experience of overseeing Spark implementations with focus on performance tuning e.g. looking at the DAG.
o Experience of ETL and Batch Processing (Streaming experience NOT required)
o Experience of implementing efficient solutions for memory, CPU and file I/O processing once data has landed on HDFS
o Produce clear & concise metrics on proposed solutions i.e. before/after picture.
o Able to use the Spark shell to prototype, validate and demonstrate changes.
o Self-starter and able to quickly grasp the fundamentals of how the current system works with minimal dependency on other developers
o Knowledge of Hadoop and its ecosystem of technologies especially Hive
o Someone who does not require constant direction but is able to work independently and produce robust designs that stand up to scrutiny
o Hands on Python/PySpark/Sparksql
o OOP concepts using Python
o Contributes to quality assurance by writing unit and functional tests.
o Basic knowledge of UNIX
o Demonstrate source control knowledge (preferably GIT)
o Ability to analyse databases directly using query language tools such as SQL
o Experience on ETL process on Big Data
o Have an understanding of data relationships, normalisation
o Should have good understanding of Big Data architecture
o Ability to interpret and write complex SQLs
• Non-Technical
o Use of JIRA / Confluence
o Appreciation of release management and software maintenance
o Contributes to problem and root cause analysis.
o Collaborates with colleagues participating in other stages of the Software Development Lifecycle (SDLC).
o Strong analytical skills.
o Ability to work in virtual teams
o Excellent team player and open minded approach
o Ability to share information, transfer knowledge and expertise to team members.
o Ability to work in a fast paced environment with competing and alternating priorities with constant focus on delivery.

Nice-to-Have Skills:
Understanding of Equities asset class
Knowledge of control M
Hands on experience of Team City
Understanding of Financial Products