Position: Big Data Engineer
Company: EPAM Systems
Experience required: 2y
Category: Java
English level: intermediate
Published: 2020-09-01T00:00:00+03:00

**Client**
The client is a global healthcare ISV and one of the top Electronic Medical Record (EMR) vendors. 
They have a multi-year program to reimagine and re-platform their legacy application suite as a SaaS based solution using modern technologies and frameworks deployed on AWS cloud.

**Solution**
Search system built with multiple modules and technologies for many years. Its SolR based deployment account for very high maintenance and operation costs. A redesign, merging the fragmented modules into a unified platform with low management costs, is planned.
Define project boundaries (dataset to index, dependencies mapped, define usage patterns and SLAs according to project goals)
Define alternative architecture blueprints
Since the system provides key functionality, is expensive to build and maintain and must be high availability:
Conduct 3-5 POCs, where a performance testbed would measure key system properties with anticipated load; alongside estimated costs
Select final technical stack; deliver an implementation roadmap

Move the existing jobs, which get records from the pre-data warehouse storage and supply analytical products to the data warehouse, to AWS EMR to better suit the workload profile. Define migration standards, deploy to production, define production operation guidelines, ensure the success of production operation then handover.

Consulting on migrating the existing HARC MapReduce jobs to AWS EMR
Revisiting source and sinks, data enhancement opportunities (HBase load)
Assistance with migration
Architects understanding dev and prod environments, mapping out how to access production workflows for later operation
Implementation and support of new EMR-based jobs.
The jobs shall be tested, optimized for performance and resource consumption
Cost-effectiveness shall be ensured

**BENEFITS**
Competitive compensation depending on experience and skills;
Individual career path in engineering;
Social package - medical insurance, sports;
Compensation for sick lists and regular vacations;
English classes with certified English teachers;
Flexible work hours.

**About EPAM**
EPAM Systems, Inc., delivers product development and platform engineering services to Global 2000 companies by solving complex business challenges with breakthrough technical innovations. 

EPAM specializes in digital transformation, business intelligence, big data and analytics, testing, next-gen architecture, digital engagement, service design and business consulting; all supported by over 23 years of software engineering expertise. 

We are among the fastest growing technology firms globally, with over 200 clients and offices in over 25 countries. We have successfully helped our clients achieve measurable business results through best-in-class software engineering, combined with innovative strategy, consulting and design capabilities.