SummaryOver 3 years of professional IT experience inData EngineeringandData Analyticsusing various languages and tools likeSQL, Python, Big HadoopExtensive experience on Data Engineering field including Ingestion, Datalake, Datawarehouse, Reporting and Analytics.Strong knowledge and experience on Data Analysis, Data Lineage, Big Data pipelines, Data quality, Data Reconciliation, Data transformation rules, Data flow diagram including Data replication, Data integration and Data orchestration toolsKnowledge and experience on AWS services like Redshift,Redshift spectrum,S3,Glue,Athena, Lambda,cloudwatch and EMRs like HIVE, PrestoExtensively used ETL methodology for performing Data Migration, Extraction, Transformation and loading usingTalendand designed data conversions from wide variety of source systems.Experienced in Data Ingestion projects to inject data intoData lakeusing multiple sources systems using Talend Bigdata.Good technical Skills inSQL Server,ETLDevelopment usingInformatica tool.Expertise in writingSQL,PL SQLto integrate of complex OLTP and OLAP database models and data marts, worked extensively onOracle, SQL SERVER.Experience in all the life cycle phases of the projects onlarge data setsand experience with performancetuningandtroubleshooting.Ability to work effectively with associates at all levels within the organization.Strong background in mathematics and have very good analytical and problem-solving skills. SkillsBig Data Ecosystems -HDFS, MapReduce, Spark, Kafka, Hive, Airflow, Stream Sets, HBase, Flume, Zookeeper, Nifi, Sentry, Ranger.Scripting Language -Python, PowerShell Scripting, Pig Latin, HiveQL.Cloud Environment -Amazon Web Services (AWS), Microsoft Azure,NoSQL DatabaseDatabase -MySQL, Oracle, Teradata, MS SQL SERVER, PostgreSQL, DB2.Version Control -Git, SVN, Bitbucket.ETL Tools -Tableau, Microsoft Excel, Informatica, Power BI, R, Google Data Studio. ExperienceData Engineer,01 2022-CurrentHoneywell Michigan,ND,Worked on Architecture Design for Multistate implementation or deployment.Implement One time Data Migration of Multistate level data from SQL server to Snowflake by using Python and SnowSQL.Day to-day responsibility includes developing ETL Pipelines in and out of data warehouse, develop major regulatory and financial reports using advanced SQL queries in snowflake.Stage the API or Kafka Data(in JSON file format) into Snowflake DB by FLATTENing the same for different functional services.Build Docker Images to run airflow on local environment to test the Ingestion as well as ETL pipelines.Building Maintaining Docker container clusters managed by Kubernetes. Utilization of Kubernetes and Docker for the runtime environment of the CI CD system to build, test and deploy.Created Airflow DAGs to schedule the Ingestions, ETL jobs and various business reports.CreatedAirflowScheduling scripts in Python.xCluster capacity planning along with operations team and management team and Cluster maintenance as well as creation and removal of nodes,HDFSsupport and maintenance.Strong knowledge ofRack awarenesstopology in theHadoop cluster.Involved in Loading data fromLINUX file systemtoHadoop Distributed File System.Responsible for building scalable distributed data solutions usingHadoop.Experience in managing and reviewingHadoop log files.Data migration fromRDMStoHadoopusingSqoopfor analysis and implementedOoziejobs for automatic data imports from source.CreatedHBasetables to store various data formats ofPIIdata coming from different portfolios.Strong in Exporting the analyzed and processed data to theRelational databasesusingSqoopfor visualization and for generation of reports for the team.Data Engineer,01 2021-12 2021Honeywell Nashville,TN,Prepared ETL design document which consists of the database structure, change data capture, Error handling, restart and refresh strategies.Worked with different feeds data like JSON, CSV, XML,DAT and implemented Data Lake concept.Developed Informatica design mappings using various transformations.Designing and building multi-terabyte, full end-to-end Data Warehouse infrastructure from the ground up on ConfidentialRedshiftfor large scale data handling Millions of records every day.Optimizing and tuning theRedshiftenvironment, enabling queries to perform up to 100x faster for Tableau and SAS Visual Analytics.Wrote various data normalization jobs for new data ingested intoRedshift.Advanced knowledge on ConfidentialRedshiftand MPP database concepts.Migrated on premise database structure to ConfidentialRedshiftdata warehouseDeveloped UDF in Scala to implement the business logic.Developed spark applications in Scala on distributed environment to load huge number of JSON files with different schema in to Hive tables.Most of the infrastructure is on AWS, used,AWS EMRDistribution for HadoopAWS S3for raw file storageAWS EC2for KafkaUsedAWS Lambdato perform data validation, filtering, sorting, or other transformations for every data change in a DynamoDB table and load the transformed data to another data store.CreatedAirflowScheduling scripts in Python.ProgrammedETL functionsbetween Oracle and Amazon Redshift.SQL Developer,06 2019-12 2023Ihs Markit Southfield,MI,Gathered business requirements and converted them into new T-SQL stored procedures in visual studio for database project.Performed unit tests on all code and packages.Analyzed requirement and impact by participating in Joint Application Development sessions with business client online.Performed and automated SQL Server version upgrades, patch installs and maintained relational databases.Performed front line code reviews for other development teams.Modified and maintained SQL Server stored procedures, views, ad-hoc queries, and SSIS packages used in the search engine optimization process.Updated existing and created new reports using Microsoft SQL Server Reporting Services. Team consisted of 2 developers.Created files, views, tables and data sets to support Sales Operations and Analytics teamsMonitored and tuned database resources and activities for SQL Server databases. EducationMaster of Science Data Analytics Engineering,Expected in12 2022-George Mason University-Fairfax,VAGPA Status-3.8 GPABachelor of Science Electronics Communication Engineering,Expected in06 2019-KL University-Guntur,GPA Status-  SEP  Company Description NBC Sports Next is where sports and technology intersect. Were a subdivision of NBC Sports and home to all NBCUniversal digital applications in sports and technology within our three groups Youth Recreational Sports Golf and Betting, Gaming Emerging Media. At NBC Sports Next, we make playing sports better through innovative technology and immersive experiences for athletes, coaches, players and fans. We equip more than 30MM players, coaches, athletes, sports administrators and fans in 40 countries with more than 25 sports solution products, including SportsEngine, the largest youth sports club, league and team management platform GolfNow, the leading online tee time marketplace and provider of golf course operations technology GolfPass the ultimate golf membership that connects golfers to exclusive content, tee time credits, and coaching, tips TeamUnify, swim team management services GoMotion, sports and fitness business software solutions and NBC Sports Edge, a leading platform for fantasy sports information and betting-focused tools. At NBC Sports Next were fueled by our mission to innovate, create larger-than-life events and connect with sports fans through technology that provides the ultimate in immersive experiences. This role is part of our Youth Recreational Sports group, comprised of technology platforms such as SportsEngine, GoMotion, TourneyMachine, and TeamUnify. We enable athletes, parents, coaches and team administrators in the youth and recreational space to manage their organizations, collect payments, share schedules, find programs to participate in and connect with other families. Additionally, NCSI enables leagues and organizations to properly screen and train coaches in an effort to keep kids safe. Job Description SportsEngine has an exciting opportunity for a Data Engineer II. In this role as part of the Data Engineering Team, you work to manage the full lifecycle of our data warehousing needs. Our data warehouse and data operations are built on top of Amazon Web Services using a modern data warehousing stack which includes the use of Amazon Redshift, Apache Airflow and Sisense for reporting. In delivering the key priorities of the role, the Data Engineer will Work within a small team of passionate data scientists and data engineers.Contribute to the management of the day to day operations of running our Data Warehouse.Build data pipelines and ETLs for loading source system data into the data warehouse for further reporting and analysis.Assist in building scalable data models to support reporting and tracking of key business and product metrics.Build, analyze and manage reports and dashboards for business stakeholders.Help identify better practices, tools, and relevant trends that can positively influence the data operations across the business. Qualifications All candidates must meet the qualifications below A minimum of 5 years of Data engineering experience is required.Experience with AWS, Python is required.Working experience in building Data Marts and Data Modeling.Deep Experience and understanding of SQL (MySQL, Postgres, Redshift).Experience with any ETL (Airflow, Boomi) tools is required.Experience with BI Tools is a must (such as Periscope, Sisense, Tableau). Desired Qualifications Are As Follows Experience with ETL (Airflow, Boomi, Stitch) tools.Python ProgrammingBI Tools (such as Periscope, Sisense, Tableau).Database (Redshift)AWS (S3 bucket, DMS, Lambda) Interested Candidates Must Submit a resumeCV through www.nbcunicareers.com to be considered. Additional Information NBCUniversal s policy is to provide equal employment opportunities to all applicants and employees without regard to race, color, religion, creed, gender, gender identity or expression, age, national origin or ancestry, citizenship, disability, sexual orientation, marital status, pregnancy, veteran status, membership in the uniformed services, genetic information, or any other basis protected by applicable law. NBCUniversal will consider for employment qualified applicants with criminal histories in a manner consistent with relevant legal requirements, including the City of Los Angeles Fair Chance Initiative For Hiring Ordinance, where applicable. If you are a qualified individual with a disability or a disabled veteran, you have the right to request a reasonable accommodation if you are unable or limited in your ability to use or access nbcunicareers.com as a result of your disability. You can request reasonable accommodations in the US by calling 1-818-777-4107 and in the UK by calling 44 2036185726.