Job description:
role: lead data engineerlocation: remoteduration: long term 8 to 10 years of experience working in data engineering, business intelligence or related field delivering large scale data platforms and services. ideal candidate will have the following skills: a successful history of manipulating, processing and extracting value from large, disconnected datasets. expertise in data modeling, data access and data storage techniques. the candidate should have foundational knowledge of dimensional modeling to build a data warehouse strong experience building transformational logic using sql on relational sql and nosql databases. skills using dbt framework for data transformation is plus robust programming skills and strong experience with python to ingest, transform and load the data experience building and optimizing big data data pipelines, architectures and data sets using tools like airflow. experience with aws cloud services: ec2, emr, rds, redshift

Resume:
<<professional summarybusiness intelligence consultant with a 10-year career in data warehousing, business intelligence reporting, and data management architecture. progressive developer and technical team lead with a strength in design & well as driving performance, reducing inefficiencies and cutting costs. possess comprehensive knowledge and hands on experience in both etl and reporting tools. knowledge of credit card account life cycle management in finance domain, functional knowledge of collections and recovery operations. expertise in planning, executing and spearheading various sdlc and agile scrum projects in compliance to quality standards. known for effective communication with excellent relationship building & interpersonal skills, strong analytical, problem solving & organizational abilities. proven track record of taking ownership and diving deeper into issues to identify the root cause and troubleshoot towards resolution. skills etl tools : ab initioscripting languages : unix shell scripting, python, spark/scalacloud services: microsoft azure cloud services, data lake , databricks and data pipelines, azure data factorybi reporting skills : tableau desktop, tableau server, power bi reporting , sap business objects (sap bo),universe designer tool, sap bo xi webi reporting,sap bo xi deski reporting,database : oracle , teradata, hivescheduler tools : autosys, control-mrelational database managementbusiness intelligence reportingproject managementdata analysis and visualization work history 06/2017tocurrentsenior data engineerthoughtworks ,a multi-tenure loyalty program across all williams sonoma brands – the first time that customers can earn points by purchasing across the multiple brands (wsi, pottery barn, west elm, etc.). i work in the customer data warehouse (cdw) which is teradata, and work with their 3rd party marketing systems vendor. there are various data points and integrations with the data warehouse, which holds all customer information, points, transactions, loyalty ids, etc.worked with requirements analysts and pdms to identify, understand and document business needs for data flow. analyze requirements/user stories at business meetings and strategize impact of requirements on different platforms/applications. worked with project management in creation of project estimates for each agile storyengaged in projects that uses scala and azure databricks/datafactory/datalake to extract, process and load adobe clickstream data received for williams sonoma ecom website. deployed custom codes in scala to read json, extract csv files from adobe, add column headers, handle bad/malformed records, handle invalid records before finally writing cleansed data into parquet/delta file format partitioned by date and hourbuild and review design deliverables. perform dependency analysis between new objects created in ab initio graphs. conduct it and uat testing of each of these graphs. record errors reported during unit and integrated testingprepare production implementation plan to deploy codes successfully to production environmentco-ordinate daily stand-ups, short meetings where teammates talk through: what's being worked on yesterday, what was done today and if blocked. involved in variety of other scrum meetings, such as planning meetings (where team pulls in stories (requirements), grooming meeting to look at backlog/list of stories and flush out timeline and work expected, demo (show work that was completed in sprint), etcreporting / visualization in tableau and power bi - design and deploy rich graphic visualizations with drill down and drop down menu option. prepare dashboards using calculations, parameters. apply various reporting objects like filters, prompts, calculated fields, groups, parameters. work on the development of dashboard reports for the key performance indicators for the top management. 03/2010to 06/2017senior developer/technical team leadtech mahindra, synchrony financial services city,state,synchrony financial is a consumer financial services company offering consumer financing products, including credit, promotional financing and loyalty programs, and installment lending, through synchrony bank, its wholly owned subsidiary. synchrony is the largest provider of private cards in the u.s. penney, cheapoair, onetravel, sams, walmart, lowe’s, guitar center, . we as data warehouse solution providers, store this credit card holder information from the instance a credit card is applied till the account is closed/charged off.understanding the full scope of requirements from business. estimating time and effort involved from gathering project requirements till project implementationanswering technical queries, driving product initiatives and metric collection and analysisco-ordinating between project stake holders – business, client and offshore teams during all phases of projectpreparing design documentation, design reviews, development, performing code reviews to ensure coding standards are followed, testing and deployment of application enhancementsexperience in ab initio toolsets including the following:o parallel and serial flow batch graphs, conditional components, other components like reformat, normalize, and join, lookup and graphs processing ascii and ebcdic layouts.o knowledge on ab- -operating system, eme and other related items.o fine tuning of ab-initio graphs based on performance enhancement by proper usage of memory in the components.o well versed with various ab initio components such as join, rollup, partition de-partition, dedup sorted, scan, -normalize.o expertise knowledge improving performance and troubleshooting of the ab-initio graphs and monitoring ab-initio run time statistics.o experience with advanced ab-initio meta-programming, air commands and other admin related tasks including the creation of. save and performing migration from one server to the other.establish support, such as acquiring conditioned test data, support from third party/team etc. for integration testing to simulate production environment and to ensure correctness and quality of build/parameter set upgetting sign off from it managers for deploying parameter/set up onto production environmentdocumenting implementation plan and hour by hour plan listing down the tasks in sequence of their execution on the date of implementation.co-ordinate release activities across multiple teams. education expected in4 2008totobachelors information technologycollege of engineering bhubaneswar,india,gpa: skills etl tools : ab initioscripting languages : unix shell scripting, python, spark/scalacloud services: microsoft azure cloud services, data lake , databricks and data pipelines, azure data factorybi reporting skills : tableau desktop, tableau server, power bi reporting , sap business objects (sap bo),universe designer tool, sap bo xi webi reporting,sap bo xi deski reporting,database : oracle , teradata, hivescheduler tools : autosys, control-mrelational database managementbusiness intelligence reportingproject managementdata analysis and visualization.