SummaryOver 3 years of professional IT experience inData EngineeringandData Analyticsusing various languages and tools likeSQL, Python, Big HadoopExtensive experience on Data Engineering field including Ingestion, Datalake, Datawarehouse, Reporting and Analytics.Strong knowledge and experience on Data Analysis, Data Lineage, Big Data pipelines, Data quality, Data Reconciliation, Data transformation rules, Data flow diagram including Data replication, Data integration and Data orchestration toolsKnowledge and experience on AWS services like Redshift,Redshift spectrum,S3,Glue,Athena, Lambda,cloudwatch and EMRs like HIVE, PrestoExtensively used ETL methodology for performing Data Migration, Extraction, Transformation and loading usingTalendand designed data conversions from wide variety of source systems.Experienced in Data Ingestion projects to inject data intoData lakeusing multiple sources systems using Talend Bigdata.Good technical Skills inSQL Server,ETLDevelopment usingInformatica tool.Expertise in writingSQL,PL SQLto integrate of complex OLTP and OLAP database models and data marts, worked extensively onOracle, SQL SERVER.Experience in all the life cycle phases of the projects onlarge data setsand experience with performancetuningandtroubleshooting.Ability to work effectively with associates at all levels within the organization.Strong background in mathematics and have very good analytical and problem-solving skills. SkillsBig Data Ecosystems -HDFS, MapReduce, Spark, Kafka, Hive, Airflow, Stream Sets, HBase, Flume, Zookeeper, Nifi, Sentry, Ranger.Scripting Language -Python, PowerShell Scripting, Pig Latin, HiveQL.Cloud Environment -Amazon Web Services (AWS), Microsoft Azure,NoSQL DatabaseDatabase -MySQL, Oracle, Teradata, MS SQL SERVER, PostgreSQL, DB2.Version Control -Git, SVN, Bitbucket.ETL Tools -Tableau, Microsoft Excel, Informatica, Power BI, R, Google Data Studio. ExperienceData Engineer,01 2022-CurrentHoneywell Michigan,ND,Worked on Architecture Design for Multistate implementation or deployment.Implement One time Data Migration of Multistate level data from SQL server to Snowflake by using Python and SnowSQL.Day to-day responsibility includes developing ETL Pipelines in and out of data warehouse, develop major regulatory and financial reports using advanced SQL queries in snowflake.Stage the API or Kafka Data(in JSON file format) into Snowflake DB by FLATTENing the same for different functional services.Build Docker Images to run airflow on local environment to test the Ingestion as well as ETL pipelines.Building Maintaining Docker container clusters managed by Kubernetes. Utilization of Kubernetes and Docker for the runtime environment of the CI CD system to build, test and deploy.Created Airflow DAGs to schedule the Ingestions, ETL jobs and various business reports.CreatedAirflowScheduling scripts in Python.xCluster capacity planning along with operations team and management team and Cluster maintenance as well as creation and removal of nodes,HDFSsupport and maintenance.Strong knowledge ofRack awarenesstopology in theHadoop cluster.Involved in Loading data fromLINUX file systemtoHadoop Distributed File System.Responsible for building scalable distributed data solutions usingHadoop.Experience in managing and reviewingHadoop log files.Data migration fromRDMStoHadoopusingSqoopfor analysis and implementedOoziejobs for automatic data imports from source.CreatedHBasetables to store various data formats ofPIIdata coming from different portfolios.Strong in Exporting the analyzed and processed data to theRelational databasesusingSqoopfor visualization and for generation of reports for the team.Data Engineer,01 2021-12 2021Honeywell Nashville,TN,Prepared ETL design document which consists of the database structure, change data capture, Error handling, restart and refresh strategies.Worked with different feeds data like JSON, CSV, XML,DAT and implemented Data Lake concept.Developed Informatica design mappings using various transformations.Designing and building multi-terabyte, full end-to-end Data Warehouse infrastructure from the ground up on ConfidentialRedshiftfor large scale data handling Millions of records every day.Optimizing and tuning theRedshiftenvironment, enabling queries to perform up to 100x faster for Tableau and SAS Visual Analytics.Wrote various data normalization jobs for new data ingested intoRedshift.Advanced knowledge on ConfidentialRedshiftand MPP database concepts.Migrated on premise database structure to ConfidentialRedshiftdata warehouseDeveloped UDF in Scala to implement the business logic.Developed spark applications in Scala on distributed environment to load huge number of JSON files with different schema in to Hive tables.Most of the infrastructure is on AWS, used,AWS EMRDistribution for HadoopAWS S3for raw file storageAWS EC2for KafkaUsedAWS Lambdato perform data validation, filtering, sorting, or other transformations for every data change in a DynamoDB table and load the transformed data to another data store.CreatedAirflowScheduling scripts in Python.ProgrammedETL functionsbetween Oracle and Amazon Redshift.SQL Developer,06 2019-12 2023Ihs Markit Southfield,MI,Gathered business requirements and converted them into new T-SQL stored procedures in visual studio for database project.Performed unit tests on all code and packages.Analyzed requirement and impact by participating in Joint Application Development sessions with business client online.Performed and automated SQL Server version upgrades, patch installs and maintained relational databases.Performed front line code reviews for other development teams.Modified and maintained SQL Server stored procedures, views, ad-hoc queries, and SSIS packages used in the search engine optimization process.Updated existing and created new reports using Microsoft SQL Server Reporting Services. Team consisted of 2 developers.Created files, views, tables and data sets to support Sales Operations and Analytics teamsMonitored and tuned database resources and activities for SQL Server databases. EducationMaster of Science Data Analytics Engineering,Expected in12 2022-George Mason University-Fairfax,VAGPA Status-3.8 GPABachelor of Science Electronics Communication Engineering,Expected in06 2019-KL University-Guntur,GPA Status-  SEP  When you join Verizon Verizon is one of the world s leading providers of technology and communications services, transforming the way we connect around the world. We re a human network that reaches across the globe and works behind the scenes. We anticipate, lead, and believe that listening is where learning begins. In crisis and in celebration, we come together-lifting up our communities and striving to make an impact to move the world forward. If you re fueled by purpose, and powered by persistence, explore a career with us. Here, you ll discover the rigor it takes to make a difference and the fulfillment that comes with living the NetworkLife. What you ll be doing... As a Sr Engr Cslt - Data Engineer within the Artificial Intelligence and Data Organization (AI D), you will manage various activities including artificial intelligence, data engineering, operations automation, security remediation and industry leading Omni channel technology to improve the efficiency, customer experience and profitability of the company. You will analyze marketing, customer experience and digital operations environments to build data pipelines, transform data into actionable intelligence. You will turn raw data into usable data pipelines and build data tools and products for effort automation and easy data accessibility. At Verizon, we are on a multi-year journey to industrialize our data science and AI capabilities. Very simply, this means that AI will fuel all decisions and business processes across the company. At 130B dollars in annual revenue, this is a pioneering opportunity to design and shape AI at scale in the Telco industry. With our leadership in bringing 5G network nationwide, the opportunity for AI will only grow exponentially in going from enabling billions of predictions to possibly trillions of predictions that are automated and real-time Manage all marketing related projects on Big DataCloud platform including design of new applications and training other developers. Gather requirements, assess gaps, and build roadmaps and architectures to help the analytics driven organization achieve its goals. Work closely with Data Analysts to ensure data quality and availability for analytical modeling. Identify gaps and implement solutions for data security, quality, and automation of processes. Support maintenance, bug fixes and performance analysis along the data pipeline. Design, build, document, test and implement new data pipelines and analytics. The job involves designing and building scalable data pipelines to provide key insights to the front-end applications and agents for quick decision making and effective channel orchestration. Collaborate in cross-functional teams to source new data, develop schema requirements, and maintain metadata Build semantic layer (curated facts), dimension tables for reports and analytics Coordination with the offshore team for design and implementation. Identify ways to improve data reliability, efficiency and quality Use large data sets to address business issues Use data to discover tasks that can be automated Design and implement fact tables, reports and dashboards using Tableau, Looker and other tools Analyze existing Teradata SQL queries for performance improvement. What we re looking for... You re curious about new technologies and the game-changing possibilities it creates. You like to stay up-to-date with the latest trends and apply your technical expertise to solve business problems. You thrive in a fast-paced, innovative environment working as a phenomenal teammate to drive the best results and business outcomes. You ll need to have Bachelor s degree or four or more years of work experience. Four or more years of relevant work experience. Even better if you have one or more of the following 3 years of Database experience in Teradata SQL, Teradata Utilities, SQL Server, SSIS, and OLAP 3 years of experience in designing, building, and deploying production-level data pipelines using tools from Hadoop stack (HDFS, Hive, Spark, Streaming, HBase, Kafka, Oozie, NiFi etc.) and programming in PythonScala 1 year(s) of experience in Cloud data engineering, preferably Google Cloud with Big Query Dashboard development experience in Tableau, Qlik andor Looker A degree. Master s degree in Computer Science, Information Systems and or related technical discipline. Teradata Big Data Analytics Certification Knowledge of telecom industry Experience to working with a distributed team Ability to effectively communicate through presentation, interpersonal, verbal and written skills. Why Verizon? Verizon is committed to maintaining a Total Rewards package which is competitive, valued by our employees, and differentiates us as an Employer of Choice. We are a pay for performance company and your contribution is rewarded through competitive salaries, performance-based incentives and an employee Stock Program. We create an opportunity for us all to share in the success of Verizon and the value we help to create through this broad-based discretionary equity award program. Your benefits are market competitive and delivered by some of the best providers. You are provided with a full spectrum of health and wellbeing resources, including a first in-class Employee Assistance Program, to empower you to make positive health decisions. We offer generous paid time off benefits to help you manage your work life balance and opportunities for flexible working arrangements . Verizon provides training and development for all levels, to help you enhance your skills and develop your career, from funding towards education assistance, award-winning training, online development tools and access to industry research. You will be able to take part in volunteering opportunities as part of our environmental, community and sustainability commitment. Your benefits package will vary depending on the country in which you work. subject to business approval If Verizon and this role sound like a fit for you, we encourage you to apply even if you don t meet every even better qualification listed above. This role is eligible to be considered for the Department of Defense SkillBridge Program. Where you ll be working In this hybrid role, you ll have a defined work location that includes work from home and assigned office days set by your manager. Scheduled Weekly Hours 40 Equal Employment Opportunity We re proud to be an equal opportunity employer - and celebrate our employees differences, including race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, and Veteran status. At Verizon, we know that diversity makes us stronger. We are committed to a collaborative, inclusive environment that encourages authenticity and fosters a sense of belonging. We strive for everyone to feel valued, connected, and empowered to reach their potential and contribute their best. Check out our diversity and inclusion page to learn more.