Professional SummaryEnergetic Data Engineer in developing robust code for high-volume businesses. Strong decision-maker with 6 years of experience in Data engineering and help firms in designing and executing solutions for complex business problems involving large scale data warehousing, real-time analytics and reporting solutions. Ability to translate business questions and concerns into specific quantitative questions that can be answered with available data using sound methodologies. SkillsPython 3.x, R, SQLHadoop, Apache SparkHive, Pig, Kafka, Sqoop, OozieTeradata, SnowflakeAmazon S3,EMR,LambdaGit, Jenkins, SplunkMS OfficeMicrosoft Visual C .NET Work HistoryData Engineer,04 2020toCurrentAvanade Bangor,ME,Combining data from multiple source systems (Profile, Systematics, etc..) and multiple platforms (Snowflake, OneLake, Hubs) and computing canonical gold-star metrics once and for all to cut operational costs.Develop Spark jobs to transform data and apply business transformation rules to load process data across enterprise and application specific layers.Experience in building operating maintaining fault tolerant and scalable data processing integrations using AWS.Configured S3 buckets with various life cycle policies to archive the infrequently accessed data based on requirement.Good working experience on submitting the Spark jobs which shows the metrics of the data which is used for Data Quality Checking.Working on building efficient data pipelines that transform high volume data into a format used for analytical, fraud prevention and ML use cases.Extensively used Splunk Search Processing Language (SPL) queries, Reports, Alerts and Dashboards.Excellent knowledge of source control management concepts such as Branching, Merging, Labeling Tagging and Integration, with tool like Git.Performing Data Quality checks like row count, schema validation, Hash key validation for all data movement between applications.Data Engineer,08 2019to04 2020Avanade Burlington,NC,Responsible for designing and developing various analytical solutions for gaining analytical insights into large data sets by ingesting and transforming these datasets in the Big Data environment using technologies like Spark, Sqoop, Oozie, HIVE.Scheduling jobs to automate the process for regular executing jobs worked on using Oozie.Developed Oozie workflow schedulers to run multiple Hive and Pig jobs that run independently with time and data availability.Familiar with data architecture including data ingestion pipeline design, Hadoop information architecture, data modeling and data mining,machine learning and advanced data processing.All the projects which I have worked for are Open Source Projects and has been tracked using JIRA.Parallel copying of files between various clusters using Distcp, Kafka in Hadoop.Data Scientist Intern,09 2018to12 2018Ascend Learning Memphis,TN,Acquire, clean, integrate, analyze and interpret disparate datasets using a variety of statistical data analysis and data visualization methodologies, reporting and authoring findings where appropriate.Developed Linear Mixed Effects Models for Boston Ed-fi dataset to estimate the teacher contribution to the student test scores.Random intercept model which utilized a pre-post-test design and included fixed effects for student demographics and a growth model where students were nested by time (random slope and intercept) and teacher was tested.Generated various Clustering models for entire West Virginia department of education and evaluated cluster s performance.Big Data Engineer,01 2014to07 2017Verizon ,,Identify customer s digital analytical needs and engage with customer and principal architects daily, understand the business requirements for big data analytical solutions and break down large scale requirements into detailed system specifications.Moving data to HDFS framework using SQOOP from Teradata, SQL Server.Good working experience on Hadoop tools related to Data warehousing like Hive, Pig and also involved in extracting the data from these tools on to the cluster using Sqoop.Solved performance issues in Hive with understanding of joins, groups, bucketing, partitions and working on them using HiveQL.Deployed programs written in PySpark to run Spark MLlib, for analytics and reduced customers churn rate by 25 . EducationMaster of Science Business Analytics,Expected in4 2020toThe University Of Texas At Dallas-Richardson,TXGPA SkillsPython 3.x, R, SQLHadoop, Apache SparkHive, Pig, Kafka, Sqoop, OozieTeradata, SnowflakeAmazon S3,EMR,LambdaGit, Jenkins, SplunkMS OfficeMicrosoft Visual C .NET  SEP  When you join Verizon Verizon is one of the world s leading providers of technology and communications services, transforming the way we connect around the world. We re a human network that reaches across the globe and works behind the scenes. We anticipate, lead, and believe that listening is where learning begins. In crisis and in celebration, we come together-lifting up our communities and striving to make an impact to move the world forward. If you re fueled by purpose, and powered by persistence, explore a career with us. Here, you ll discover the rigor it takes to make a difference and the fulfillment that comes with living the NetworkLife. What you ll be doing... As a Sr Engr Cslt - Data Engineer within the Artificial Intelligence and Data Organization (AI D), you will manage various activities including artificial intelligence, data engineering, operations automation, security remediation and industry leading Omni channel technology to improve the efficiency, customer experience and profitability of the company. You will analyze marketing, customer experience and digital operations environments to build data pipelines, transform data into actionable intelligence. You will turn raw data into usable data pipelines and build data tools and products for effort automation and easy data accessibility. At Verizon, we are on a multi-year journey to industrialize our data science and AI capabilities. Very simply, this means that AI will fuel all decisions and business processes across the company. At 130B dollars in annual revenue, this is a pioneering opportunity to design and shape AI at scale in the Telco industry. With our leadership in bringing 5G network nationwide, the opportunity for AI will only grow exponentially in going from enabling billions of predictions to possibly trillions of predictions that are automated and real-time Manage all marketing related projects on Big DataCloud platform including design of new applications and training other developers. Gather requirements, assess gaps, and build roadmaps and architectures to help the analytics driven organization achieve its goals. Work closely with Data Analysts to ensure data quality and availability for analytical modeling. Identify gaps and implement solutions for data security, quality, and automation of processes. Support maintenance, bug fixes and performance analysis along the data pipeline. Design, build, document, test and implement new data pipelines and analytics. The job involves designing and building scalable data pipelines to provide key insights to the front-end applications and agents for quick decision making and effective channel orchestration. Collaborate in cross-functional teams to source new data, develop schema requirements, and maintain metadata Build semantic layer (curated facts), dimension tables for reports and analytics Coordination with the offshore team for design and implementation. Identify ways to improve data reliability, efficiency and quality Use large data sets to address business issues Use data to discover tasks that can be automated Design and implement fact tables, reports and dashboards using Tableau, Looker and other tools Analyze existing Teradata SQL queries for performance improvement. What we re looking for... You re curious about new technologies and the game-changing possibilities it creates. You like to stay up-to-date with the latest trends and apply your technical expertise to solve business problems. You thrive in a fast-paced, innovative environment working as a phenomenal teammate to drive the best results and business outcomes. You ll need to have Bachelor s degree or four or more years of work experience. Four or more years of relevant work experience. Even better if you have one or more of the following 3 years of Database experience in Teradata SQL, Teradata Utilities, SQL Server, SSIS, and OLAP 3 years of experience in designing, building, and deploying production-level data pipelines using tools from Hadoop stack (HDFS, Hive, Spark, Streaming, HBase, Kafka, Oozie, NiFi etc.) and programming in PythonScala 1 year(s) of experience in Cloud data engineering, preferably Google Cloud with Big Query Dashboard development experience in Tableau, Qlik andor Looker A degree. Master s degree in Computer Science, Information Systems and or related technical discipline. Teradata Big Data Analytics Certification Knowledge of telecom industry Experience to working with a distributed team Ability to effectively communicate through presentation, interpersonal, verbal and written skills. Why Verizon? Verizon is committed to maintaining a Total Rewards package which is competitive, valued by our employees, and differentiates us as an Employer of Choice. We are a pay for performance company and your contribution is rewarded through competitive salaries, performance-based incentives and an employee Stock Program. We create an opportunity for us all to share in the success of Verizon and the value we help to create through this broad-based discretionary equity award program. Your benefits are market competitive and delivered by some of the best providers. You are provided with a full spectrum of health and wellbeing resources, including a first in-class Employee Assistance Program, to empower you to make positive health decisions. We offer generous paid time off benefits to help you manage your work life balance and opportunities for flexible working arrangements . Verizon provides training and development for all levels, to help you enhance your skills and develop your career, from funding towards education assistance, award-winning training, online development tools and access to industry research. You will be able to take part in volunteering opportunities as part of our environmental, community and sustainability commitment. Your benefits package will vary depending on the country in which you work. subject to business approval If Verizon and this role sound like a fit for you, we encourage you to apply even if you don t meet every even better qualification listed above. This role is eligible to be considered for the Department of Defense SkillBridge Program. Where you ll be working In this hybrid role, you ll have a defined work location that includes work from home and assigned office days set by your manager. Scheduled Weekly Hours 40 Equal Employment Opportunity We re proud to be an equal opportunity employer - and celebrate our employees differences, including race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, and Veteran status. At Verizon, we know that diversity makes us stronger. We are committed to a collaborative, inclusive environment that encourages authenticity and fosters a sense of belonging. We strive for everyone to feel valued, connected, and empowered to reach their potential and contribute their best. Check out our diversity and inclusion page to learn more.