Position: BigData Technical Lead
Company: EPAM
Category: Java
Experience required: 5y
English level: upper
Published: 2021-04-01T00:00:00+03:00

The client is a global healthcare ISV and one of the top Electronic Medical Record (EMR) vendors. 

They have a multi-year program to reimagine and re-platform their legacy application suite as a SaaS based solution using modern technologies and frameworks deployed on AWS cloud.

Solution: Search system built with multiple modules and technologies during many years. Its SolR based deployment account for very high maintenance and operation costs. A redesign, merging the fragmented modules into a unified platform with low management costs, is planned.

Define project boundaries (dataset to index, dependencies mapped, define usage patterns and SLAs according to project goals)

Define alternative architecture blueprints

Since the system provides key functionality, is expensive to build and maintain and must be high availability:

Conduct 3-5 POCs, where a performance testbed would measure key system properties with anticipated load; alongside estimated costs

Select final technical stack; deliver an implementation roadmap

Move the existing jobs, which get records from the pre-data warehouse storage and supply analytical products to the data warehouse, to AWS EMR to better suit the workload profile. Define migration standards, deploy to production, define production operation guidelines, ensure success of production operation then handover.

Consulting on migrating the existing HARC MapReduce jobs to AWS EMR

Revisiting source and sinks, data enhancement opportunities (HBase load)

Assistance with migration

Architects understanding dev and prod environments, mapping out how to access production workflows for later operation

Implementation and support of new EMR-based jobs.

The jobs shall be tested, optimized for performance and resource consumption

Cost-effectiveness shall be ensured

(168329489)