Professional SummaryEnergetic Data Engineer in developing robust code for high-volume businesses. Strong decision-maker with 6 years of experience in Data engineering and help firms in designing and executing solutions for complex business problems involving large scale data warehousing, real-time analytics and reporting solutions. Ability to translate business questions and concerns into specific quantitative questions that can be answered with available data using sound methodologies. SkillsPython 3.x, R, SQLHadoop, Apache SparkHive, Pig, Kafka, Sqoop, OozieTeradata, SnowflakeAmazon S3,EMR,LambdaGit, Jenkins, SplunkMS OfficeMicrosoft Visual C .NET EducationThe University Of Texas At DallasRichardson,TXExpected in4 2020 Master of Science Business Analytics-GPA Work HistoryAvanade-Data EngineerBangor,ME,04 2020-CurrentCombining data from multiple source systems (Profile, Systematics, etc..) and multiple platforms (Snowflake, OneLake, Hubs) and computing canonical gold-star metrics once and for all to cut operational costs.Develop Spark jobs to transform data and apply business transformation rules to load process data across enterprise and application specific layers.Experience in building operating maintaining fault tolerant and scalable data processing integrations using AWS.Configured S3 buckets with various life cycle policies to archive the infrequently accessed data based on requirement.Good working experience on submitting the Spark jobs which shows the metrics of the data which is used for Data Quality Checking.Working on building efficient data pipelines that transform high volume data into a format used for analytical, fraud prevention and ML use cases.Extensively used Splunk Search Processing Language (SPL) queries, Reports, Alerts and Dashboards.Excellent knowledge of source control management concepts such as Branching, Merging, Labeling Tagging and Integration, with tool like Git.Performing Data Quality checks like row count, schema validation, Hash key validation for all data movement between applications.Avanade-Data EngineerBurlington,NC,08 2019-04 2020Responsible for designing and developing various analytical solutions for gaining analytical insights into large data sets by ingesting and transforming these datasets in the Big Data environment using technologies like Spark, Sqoop, Oozie, HIVE.Scheduling jobs to automate the process for regular executing jobs worked on using Oozie.Developed Oozie workflow schedulers to run multiple Hive and Pig jobs that run independently with time and data availability.Familiar with data architecture including data ingestion pipeline design, Hadoop information architecture, data modeling and data mining,machine learning and advanced data processing.All the projects which I have worked for are Open Source Projects and has been tracked using JIRA.Parallel copying of files between various clusters using Distcp, Kafka in Hadoop.Ascend Learning-Data Scientist InternMemphis,TN,09 2018-12 2018Acquire, clean, integrate, analyze and interpret disparate datasets using a variety of statistical data analysis and data visualization methodologies, reporting and authoring findings where appropriate.Developed Linear Mixed Effects Models for Boston Ed-fi dataset to estimate the teacher contribution to the student test scores.Random intercept model which utilized a pre-post-test design and included fixed effects for student demographics and a growth model where students were nested by time (random slope and intercept) and teacher was tested.Generated various Clustering models for entire West Virginia department of education and evaluated cluster s performance.Verizon-Big Data Engineer,,01 2014-07 2017Identify customer s digital analytical needs and engage with customer and principal architects daily, understand the business requirements for big data analytical solutions and break down large scale requirements into detailed system specifications.Moving data to HDFS framework using SQOOP from Teradata, SQL Server.Good working experience on Hadoop tools related to Data warehousing like Hive, Pig and also involved in extracting the data from these tools on to the cluster using Sqoop.Solved performance issues in Hive with understanding of joins, groups, bucketing, partitions and working on them using HiveQL.Deployed programs written in PySpark to run Spark MLlib, for analytics and reduced customers churn rate by 25 . SkillsPython 3.x, R, SQLHadoop, Apache SparkHive, Pig, Kafka, Sqoop, OozieTeradata, SnowflakeAmazon S3,EMR,LambdaGit, Jenkins, SplunkMS OfficeMicrosoft Visual C .NET  SEP  Reviews, analyzes, and evaluates business systems and user needs. Formulates systems to parallel overall business strategies. Experienced with business process reengineering and identifying new applications of technology to business problems to make business more effective. Familiar with industry standard business process mapping, and reengineering. Prepares solution options, risk identification, and financial analyses such as costbenefit, ROI, buybuild, etc. Writes detailed description of user needs, program functions, and steps required to develop or modify computer programs. This position will work on the Grants Management application. This position will perform the duties of a Business Analyst including requirement gathering, analysis of requirements, development of requirements and design for required system modifications, completing business requirement documents, user stories, and business area collaboration andor coordination. Will also work with technical teams to coordinate demos, UAT, code releases, and user communication as necessary. Must have experience working in an Agile environment. Some on-call support may be required depending on the project phase. II. CANDIDATE SKILLS AND QUALIFICATIONS Minimum Requirements Candidates that do not meet or exceed the minimum stated requirements (skillsexperience) will be displayed to customers but may not be chosen for this opportunity.YearsRequiredPreferredExperience8RequiredBusiness Analyst Experience8RequiredSQL Experience8RequiredSystem Reporting (Oracle, SQL)8RequiredSystems Testing (Unit, Integration, UAT)8RequiredExcellent communication skills (verbal and in writing)4PreferredAgile Software Development Methodologies Experience2PreferredProject andor Product Management experience1PreferredExperience with Jira III. TERMS OF SERVICE Services are expected to start 10022023 and are expected to complete by 08312024. Total estimated hours per Candidate shall not exceed 1850 hours. This service may be amended, renewed, andor extended providing both parties agree to do so in writing. IV. WORK HOURS AND LOCATION Services shall be provided during normal business hours unless otherwise coordinated through the Texas Health and Human Services Commission. Normal business hours are Monday through Friday from 8 00 AM to 5 00 PM, excluding State holidays when the agency is closed. The primary work location(s) will be at 701 W 51st St Austin, TX 78751. Any and all travel, per diem, parking, andor living expenses shall be at the Candidate s andor Vendor s expense. Texas Health and Human Services Commission will provide pre-approved, written authorization for travel for any services to be performed away from the primary work location(s). Pre-approved travel expenses are limited to the rates and comply with the rules prescribed by the State of Texas for travel by its classified employees, including any requirement for original receipts. The Candidate(s) may be required to work outside the normal business hours on weekends, evenings and holidays, as requested. Payment for work over 40 hours will be at the hourly rate quoted and must be coordinated and pre-approved through Texas Health and Human Services Commission. V. OTHER SPECIAL REQUIREMENTS Remote work Mon - FriLocation within the state of TexasInterviews will be conducted through Microsoft Teams