Professional SummaryEnergetic Data Engineer in developing robust code for high-volume businesses. Strong decision-maker with 6 years of experience in Data engineering and help firms in designing and executing solutions for complex business problems involving large scale data warehousing, real-time analytics and reporting solutions. Ability to translate business questions and concerns into specific quantitative questions that can be answered with available data using sound methodologies. SkillsPython 3.x, R, SQLHadoop, Apache SparkHive, Pig, Kafka, Sqoop, OozieTeradata, SnowflakeAmazon S3,EMR,LambdaGit, Jenkins, SplunkMS OfficeMicrosoft Visual C .NET Work HistoryData Engineer,04 2020toCurrentAvanade Bangor,ME,Combining data from multiple source systems (Profile, Systematics, etc..) and multiple platforms (Snowflake, OneLake, Hubs) and computing canonical gold-star metrics once and for all to cut operational costs.Develop Spark jobs to transform data and apply business transformation rules to load process data across enterprise and application specific layers.Experience in building operating maintaining fault tolerant and scalable data processing integrations using AWS.Configured S3 buckets with various life cycle policies to archive the infrequently accessed data based on requirement.Good working experience on submitting the Spark jobs which shows the metrics of the data which is used for Data Quality Checking.Working on building efficient data pipelines that transform high volume data into a format used for analytical, fraud prevention and ML use cases.Extensively used Splunk Search Processing Language (SPL) queries, Reports, Alerts and Dashboards.Excellent knowledge of source control management concepts such as Branching, Merging, Labeling Tagging and Integration, with tool like Git.Performing Data Quality checks like row count, schema validation, Hash key validation for all data movement between applications.Data Engineer,08 2019to04 2020Avanade Burlington,NC,Responsible for designing and developing various analytical solutions for gaining analytical insights into large data sets by ingesting and transforming these datasets in the Big Data environment using technologies like Spark, Sqoop, Oozie, HIVE.Scheduling jobs to automate the process for regular executing jobs worked on using Oozie.Developed Oozie workflow schedulers to run multiple Hive and Pig jobs that run independently with time and data availability.Familiar with data architecture including data ingestion pipeline design, Hadoop information architecture, data modeling and data mining,machine learning and advanced data processing.All the projects which I have worked for are Open Source Projects and has been tracked using JIRA.Parallel copying of files between various clusters using Distcp, Kafka in Hadoop.Data Scientist Intern,09 2018to12 2018Ascend Learning Memphis,TN,Acquire, clean, integrate, analyze and interpret disparate datasets using a variety of statistical data analysis and data visualization methodologies, reporting and authoring findings where appropriate.Developed Linear Mixed Effects Models for Boston Ed-fi dataset to estimate the teacher contribution to the student test scores.Random intercept model which utilized a pre-post-test design and included fixed effects for student demographics and a growth model where students were nested by time (random slope and intercept) and teacher was tested.Generated various Clustering models for entire West Virginia department of education and evaluated cluster s performance.Big Data Engineer,01 2014to07 2017Verizon ,,Identify customer s digital analytical needs and engage with customer and principal architects daily, understand the business requirements for big data analytical solutions and break down large scale requirements into detailed system specifications.Moving data to HDFS framework using SQOOP from Teradata, SQL Server.Good working experience on Hadoop tools related to Data warehousing like Hive, Pig and also involved in extracting the data from these tools on to the cluster using Sqoop.Solved performance issues in Hive with understanding of joins, groups, bucketing, partitions and working on them using HiveQL.Deployed programs written in PySpark to run Spark MLlib, for analytics and reduced customers churn rate by 25 . EducationMaster of Science Business Analytics,Expected in4 2020toThe University Of Texas At Dallas-Richardson,TXGPA SkillsPython 3.x, R, SQLHadoop, Apache SparkHive, Pig, Kafka, Sqoop, OozieTeradata, SnowflakeAmazon S3,EMR,LambdaGit, Jenkins, SplunkMS OfficeMicrosoft Visual C .NET  SEP  Company Description NBC Sports Next is where sports and technology intersect. Were a subdivision of NBC Sports and home to all NBCUniversal digital applications in sports and technology within our three groups Youth Recreational Sports Golf and Betting, Gaming Emerging Media. At NBC Sports Next, we make playing sports better through innovative technology and immersive experiences for athletes, coaches, players and fans. We equip more than 30MM players, coaches, athletes, sports administrators and fans in 40 countries with more than 25 sports solution products, including SportsEngine, the largest youth sports club, league and team management platform GolfNow, the leading online tee time marketplace and provider of golf course operations technology GolfPass the ultimate golf membership that connects golfers to exclusive content, tee time credits, and coaching, tips TeamUnify, swim team management services GoMotion, sports and fitness business software solutions and NBC Sports Edge, a leading platform for fantasy sports information and betting-focused tools. At NBC Sports Next were fueled by our mission to innovate, create larger-than-life events and connect with sports fans through technology that provides the ultimate in immersive experiences. This role is part of our Youth Recreational Sports group, comprised of technology platforms such as SportsEngine, GoMotion, TourneyMachine, and TeamUnify. We enable athletes, parents, coaches and team administrators in the youth and recreational space to manage their organizations, collect payments, share schedules, find programs to participate in and connect with other families. Additionally, NCSI enables leagues and organizations to properly screen and train coaches in an effort to keep kids safe. Job Description SportsEngine has an exciting opportunity for a Data Engineer II. In this role as part of the Data Engineering Team, you work to manage the full lifecycle of our data warehousing needs. Our data warehouse and data operations are built on top of Amazon Web Services using a modern data warehousing stack which includes the use of Amazon Redshift, Apache Airflow and Sisense for reporting. In delivering the key priorities of the role, the Data Engineer will Work within a small team of passionate data scientists and data engineers.Contribute to the management of the day to day operations of running our Data Warehouse.Build data pipelines and ETLs for loading source system data into the data warehouse for further reporting and analysis.Assist in building scalable data models to support reporting and tracking of key business and product metrics.Build, analyze and manage reports and dashboards for business stakeholders.Help identify better practices, tools, and relevant trends that can positively influence the data operations across the business. Qualifications All candidates must meet the qualifications below A minimum of 5 years of Data engineering experience is required.Experience with AWS, Python is required.Working experience in building Data Marts and Data Modeling.Deep Experience and understanding of SQL (MySQL, Postgres, Redshift).Experience with any ETL (Airflow, Boomi) tools is required.Experience with BI Tools is a must (such as Periscope, Sisense, Tableau). Desired Qualifications Are As Follows Experience with ETL (Airflow, Boomi, Stitch) tools.Python ProgrammingBI Tools (such as Periscope, Sisense, Tableau).Database (Redshift)AWS (S3 bucket, DMS, Lambda) Interested Candidates Must Submit a resumeCV through www.nbcunicareers.com to be considered. Additional Information NBCUniversal s policy is to provide equal employment opportunities to all applicants and employees without regard to race, color, religion, creed, gender, gender identity or expression, age, national origin or ancestry, citizenship, disability, sexual orientation, marital status, pregnancy, veteran status, membership in the uniformed services, genetic information, or any other basis protected by applicable law. NBCUniversal will consider for employment qualified applicants with criminal histories in a manner consistent with relevant legal requirements, including the City of Los Angeles Fair Chance Initiative For Hiring Ordinance, where applicable. If you are a qualified individual with a disability or a disabled veteran, you have the right to request a reasonable accommodation if you are unable or limited in your ability to use or access nbcunicareers.com as a result of your disability. You can request reasonable accommodations in the US by calling 1-818-777-4107 and in the UK by calling 44 2036185726.