For the given job description <<Job Description
I am actively seeking an experienced Data Engineer to join an innovative SaaS company within the AI & AdTech space. The ideal candidate is passionate about data, is highly self-motivated, enjoys collaborative work environments, and has a seasoned background in software development.
Requirements
At least 8 years of professional engineering experience At least 5 years of hands-on data engineering experience with ScalaSpark At least 3 years of hands-on software development experience with Java & Spring for REST API development Highly proficient in designing, building, deploying, etc. new ETL data pipelines, databases, features and systems Expert level Spark knowledge Experience with Relational databases Cloud technology experience (AWS is highly preferred) B.S. or higher in Computer Science, or related field 
Bonus Points
Background working in a SaaS product based environment Experience andor exposure to the full software development life cycle (SDLC) of a product Lead andor mentorship experience 
This is a full time, direct hire position. The comp & benefits package includes a base, annual bonus, unlimited PTO, healthcare coverage, and much more!
This position is fully remote anywhere in the United States, except California.
Visa sponsorship is not available at this time**

>> the resume: <<Professional SummaryBusiness Intelligence Consultant with a 10-year career in data warehousing, business intelligence reporting, and data management architecture. Progressive developer and technical team lead with a strength in design & development, as well as driving performance, reducing inefficiencies and cutting costs. Possess comprehensive knowledge and hands on experience in both ETL and Reporting tools. Knowledge of Credit Card account life cycle management in Finance domain, Functional knowledge of Collections and Recovery operations. Expertise in planning, executing and spearheading various SDLC and Agile Scrum projects in compliance to quality standards. Known for effective communication with excellent relationship building & interpersonal skills, strong analytical, problem solving & organizational abilities. Proven track record of taking ownership and diving deeper into issues to identify the root cause and troubleshoot towards resolution.
SkillsETL Tools : Ab InitioScripting Languages : Unix shell scripting, Python, Spark/ScalaCloud Services: Microsoft Azure Cloud Services, Data Lake , DataBricks and Data Pipelines, Azure Data FactoryBI Reporting Skills : Tableau Desktop, Tableau Server, Power BI Reporting , SAP Business Objects (SAP BO),Universe Designer Tool, SAP BO XI WEBI Reporting,SAP BO XI Deski Reporting,Database : Oracle , Teradata, HiveScheduler tools : Autosys, Control-MRelational Database ManagementBusiness Intelligence ReportingProject ManagementData Analysis and Visualization
Work History06/2017toCurrentSenior Data EngineerThoughtworks|Memphis,TN,A multi-tenure loyalty program across all Williams Sonoma brands – the first time that customers can earn points by purchasing across the multiple brands (WSI, Pottery Barn, West Elm, etc.). I work in the customer data warehouse (CDW) which is Teradata, and work with their 3rd party marketing systems vendor. There are various data points and integrations with the data warehouse, which holds all customer information, points, transactions, loyalty IDs, etc.Worked with Requirements Analysts and PDMs to identify, understand and document business needs for data flow. Analyze requirements/User stories at business meetings and strategize impact of requirements on different platforms/applications. Worked with Project Management in creation of project estimates for each Agile storyEngaged in projects that uses Scala and Azure Databricks/Datafactory/Datalake to extract, process and load Adobe Clickstream data received for Williams Sonoma ECOM website. Deployed custom codes in Scala to read JSON, extract CSV files from Adobe, add column headers, handle bad/malformed records, handle invalid records before finally writing cleansed data into Parquet/Delta file format partitioned by date and hourBuild and review design deliverables. Perform dependency analysis between new objects created in Ab Initio graphs. Conduct IT and UAT testing of each of these graphs. Record errors reported during Unit and Integrated testingPrepare production Implementation Plan to deploy codes successfully to production environmentCo-ordinate daily stand-ups, short meetings where teammates talk through: what's being worked on yesterday, what was done today and if blocked. Involved in variety of other scrum meetings, such as planning meetings (where team pulls in stories (requirements), grooming meeting to look at backlog/list of stories and flush out timeline and work expected, demo (show work that was completed in sprint), etcReporting / Visualization in Tableau and Power BI - Design and deploy rich Graphic visualizations with Drill Down and Drop down menu option. Prepare Dashboards using calculations, parameters. Apply various reporting objects like Filters, prompts, Calculated fields, Groups, Parameters. Work on the development of Dashboard reports for the Key Performance Indicators for the top management.03/2010to06/2017Senior Developer/Technical Team LeadTech Mahindra, Synchrony Financial Services|City,STATE,Synchrony Financial is a consumer financial services company offering consumer financing products, including credit, promotional financing and loyalty programs, and installment lending, through Synchrony Bank, its wholly owned subsidiary. Synchrony is the largest provider of private label credit cards in the U.S. The company provides private label credit cards for such brands as Amazon, JC Penney, CheapOAir, OneTravel, Sams, Walmart, Lowe’s, Guitar Center, Gap, BP. We as Data warehouse solution providers, store this credit card holder information from the instance a credit card is applied till the account is closed/charged off.Understanding the full scope of requirements from business. Estimating time and effort involved from gathering project requirements till project implementationAnswering technical queries, driving product initiatives and metric collection and analysisCo-Ordinating between project stake holders – Business, Client and offshore teams during all phases of projectPreparing design documentation, design reviews, development, performing code reviews to ensure coding standards are followed, testing and deployment of application enhancementsExperience in Ab Initio toolsets including the following:o Parallel and serial flow batch graphs, conditional components, other components like reformat, normalize, and join, lookup and graphs processing ASCII and EBCDIC layouts.o Knowledge on Ab-initio architecture including the GDE, Co-operating system, EME and other related items.o Fine tuning of Ab-initio graphs based on performance enhancement by proper usage of memory in the components.o Well versed with various Ab Initio components such as Join, Rollup, Partition De-partition, Dedup sorted, Scan, Normalize, De-Normalize.o Expertise knowledge improving Performance and Troubleshooting of the Ab-Initio graphs and monitoring AB-Initio run time statistics.o Experience with advanced Ab-initio meta-programming, air commands and other admin related tasks including the creation of. save and performing migration from one server to the other.Establish support, such as acquiring conditioned test data, support from third party/team etc. for Integration Testing to simulate production environment and to ensure correctness and quality of build/parameter set upGetting sign off from IT managers for deploying parameter/set up onto production environmentDocumenting implementation plan and Hour by Hour plan listing down the tasks in sequence of their execution on the date of implementation.Co-ordinate release activities across multiple teams.
EducationExpected in4 2008totoBachelors|Information TechnologyCollege of Engineering Bhubaneswar,India,GPA:
SkillsETL Tools : Ab InitioScripting Languages : Unix shell scripting, Python, Spark/ScalaCloud Services: Microsoft Azure Cloud Services, Data Lake , DataBricks and Data Pipelines, Azure Data FactoryBI Reporting Skills : Tableau Desktop, Tableau Server, Power BI Reporting , SAP Business Objects (SAP BO),Universe Designer Tool, SAP BO XI WEBI Reporting,SAP BO XI Deski Reporting,Database : Oracle , Teradata, HiveScheduler tools : Autosys, Control-MRelational Database ManagementBusiness Intelligence ReportingProject ManagementData Analysis and Visualization>>. The result is, Potential Fit

Fit assessment: Potential Fit