SummaryOver 3 years of professional IT experience inData EngineeringandData Analyticsusing various languages and tools likeSQL, Python, Big HadoopExtensive experience on Data Engineering field including Ingestion, Datalake, Datawarehouse, Reporting and Analytics.Strong knowledge and experience on Data Analysis, Data Lineage, Big Data pipelines, Data quality, Data Reconciliation, Data transformation rules, Data flow diagram including Data replication, Data integration and Data orchestration toolsKnowledge and experience on AWS services like Redshift,Redshift spectrum,S3,Glue,Athena, Lambda,cloudwatch and EMRs like HIVE, PrestoExtensively used ETL methodology for performing Data Migration, Extraction, Transformation and loading usingTalendand designed data conversions from wide variety of source systems.Experienced in Data Ingestion projects to inject data intoData lakeusing multiple sources systems using Talend Bigdata.Good technical Skills inSQL Server,ETLDevelopment usingInformatica tool.Expertise in writingSQL,PL SQLto integrate of complex OLTP and OLAP database models and data marts, worked extensively onOracle, SQL SERVER.Experience in all the life cycle phases of the projects onlarge data setsand experience with performancetuningandtroubleshooting.Ability to work effectively with associates at all levels within the organization.Strong background in mathematics and have very good analytical and problem-solving skills. SkillsBig Data Ecosystems -HDFS, MapReduce, Spark, Kafka, Hive, Airflow, Stream Sets, HBase, Flume, Zookeeper, Nifi, Sentry, Ranger.Scripting Language -Python, PowerShell Scripting, Pig Latin, HiveQL.Cloud Environment -Amazon Web Services (AWS), Microsoft Azure,NoSQL DatabaseDatabase -MySQL, Oracle, Teradata, MS SQL SERVER, PostgreSQL, DB2.Version Control -Git, SVN, Bitbucket.ETL Tools -Tableau, Microsoft Excel, Informatica, Power BI, R, Google Data Studio. ExperienceData Engineer,01 2022-CurrentHoneywell Michigan,ND,Worked on Architecture Design for Multistate implementation or deployment.Implement One time Data Migration of Multistate level data from SQL server to Snowflake by using Python and SnowSQL.Day to-day responsibility includes developing ETL Pipelines in and out of data warehouse, develop major regulatory and financial reports using advanced SQL queries in snowflake.Stage the API or Kafka Data(in JSON file format) into Snowflake DB by FLATTENing the same for different functional services.Build Docker Images to run airflow on local environment to test the Ingestion as well as ETL pipelines.Building Maintaining Docker container clusters managed by Kubernetes. Utilization of Kubernetes and Docker for the runtime environment of the CI CD system to build, test and deploy.Created Airflow DAGs to schedule the Ingestions, ETL jobs and various business reports.CreatedAirflowScheduling scripts in Python.xCluster capacity planning along with operations team and management team and Cluster maintenance as well as creation and removal of nodes,HDFSsupport and maintenance.Strong knowledge ofRack awarenesstopology in theHadoop cluster.Involved in Loading data fromLINUX file systemtoHadoop Distributed File System.Responsible for building scalable distributed data solutions usingHadoop.Experience in managing and reviewingHadoop log files.Data migration fromRDMStoHadoopusingSqoopfor analysis and implementedOoziejobs for automatic data imports from source.CreatedHBasetables to store various data formats ofPIIdata coming from different portfolios.Strong in Exporting the analyzed and processed data to theRelational databasesusingSqoopfor visualization and for generation of reports for the team.Data Engineer,01 2021-12 2021Honeywell Nashville,TN,Prepared ETL design document which consists of the database structure, change data capture, Error handling, restart and refresh strategies.Worked with different feeds data like JSON, CSV, XML,DAT and implemented Data Lake concept.Developed Informatica design mappings using various transformations.Designing and building multi-terabyte, full end-to-end Data Warehouse infrastructure from the ground up on ConfidentialRedshiftfor large scale data handling Millions of records every day.Optimizing and tuning theRedshiftenvironment, enabling queries to perform up to 100x faster for Tableau and SAS Visual Analytics.Wrote various data normalization jobs for new data ingested intoRedshift.Advanced knowledge on ConfidentialRedshiftand MPP database concepts.Migrated on premise database structure to ConfidentialRedshiftdata warehouseDeveloped UDF in Scala to implement the business logic.Developed spark applications in Scala on distributed environment to load huge number of JSON files with different schema in to Hive tables.Most of the infrastructure is on AWS, used,AWS EMRDistribution for HadoopAWS S3for raw file storageAWS EC2for KafkaUsedAWS Lambdato perform data validation, filtering, sorting, or other transformations for every data change in a DynamoDB table and load the transformed data to another data store.CreatedAirflowScheduling scripts in Python.ProgrammedETL functionsbetween Oracle and Amazon Redshift.SQL Developer,06 2019-12 2023Ihs Markit Southfield,MI,Gathered business requirements and converted them into new T-SQL stored procedures in visual studio for database project.Performed unit tests on all code and packages.Analyzed requirement and impact by participating in Joint Application Development sessions with business client online.Performed and automated SQL Server version upgrades, patch installs and maintained relational databases.Performed front line code reviews for other development teams.Modified and maintained SQL Server stored procedures, views, ad-hoc queries, and SSIS packages used in the search engine optimization process.Updated existing and created new reports using Microsoft SQL Server Reporting Services. Team consisted of 2 developers.Created files, views, tables and data sets to support Sales Operations and Analytics teamsMonitored and tuned database resources and activities for SQL Server databases. EducationMaster of Science Data Analytics Engineering,Expected in12 2022-George Mason University-Fairfax,VAGPA Status-3.8 GPABachelor of Science Electronics Communication Engineering,Expected in06 2019-KL University-Guntur,GPA Status-  SEP  Job Description Summary Our mission is to provide a great software product to our aviation customers with world class engineering solutions. We are looking for a Data Engineer to join one of our growing teams. The ideal candidate will thrive in a dynamic, results-driven, team-oriented environment. This role is responsible for developing data engineering jobs and workflows that enable data analytics and reporting solutions based on the given design and architecture. In this role you will see yourself responsible for executing and delivering the results using agile methodologies. This role is also responsible for providing post-deployment support, when needed. Job Description CAN WORK REMOTELY WITHIN US Roles And Responsibilities In this role you will Configure existing applications to consume new and modified customer data feeds. Perform data profiling and data analysis for any source systems and the target data repositories. Understand metadata and the underlying data structures needed to standardize the data load processes. Develop data mapping specifications based on the results of data analysis and functional requirements. Build automated Extract, Transform Load (ETL) jobs based on data mapping specifications. Create and enhance automation on frequently executed tasks. Validate the data mapping results. Implement new and ensure compliance with Data Quality (DQ) rules provided. Implement and control the use of master data configurations. Participate in the requirement gathering process and implement new solutions to address customer needs. Basic Requirements Bachelor s Degree in Computer Science or STEM Majors (Science, Technology, Engineering and Math) Role is posted for Austin, TX but is open for remote work opportunitiesMust be able to legally work in the country to which you have applied for. We will not sponsor individuals for employment visas, now or in the future for this job. Desired Characteristics Hands-on experience in scripting and programming languages like Python, C and Powershell. Hands-on experience in writing SQL scripts for SQL Server, Oracle, MySQL, or PostgreSQL. Exposure to Data visualization or reporting tools like PowerBI, Tableau or SSRS. Experience with aircraft data frames such as DFDR, QAR, ARINC-717, ARINC-429, etc. Experience in handling regular expressions. Exposure to Extract, Transform Load (ETL) tools. Personal And Leadership Attributes Effective written and oral communication and interpersonal skills, bilingual preferred. Demonstrates the ability to help team members. Inquisitive with a desire to learn and grow quickly as a contributor to the larger team. Identifies opportunities for innovation and offers new ideas. Takes the initiative to experiment with new software frameworks. Adapts to new environments and changing requirements. Pivots quickly as needed. When coached, responds to need seeks info from other sources. Communicates project status or challenges in a clear and concise manner to other team members. Did you know that research has shown that women and people of color are less likely to apply to a job unless they meet 100 of the requirements? GE Digital is committed to building an inclusive workplace where everyone feels like they belong and can bring their entire selves to work this drives our innovation! Even if you dont meet every one of the preferred criteria in this job description, we encourage you to still apply as you might be a fantastic fit for this role, or other currently open roles. About Us At GE Digital, we are creating technology and solutions to enable social, mobile, analytical and cloud capabilities for the Industrial Internet. The Industrial Internet is an open, global network that connects people, data, and machines. Its about making infrastructure more intelligent and advancing the industries critical to the world we live in. At GE, we believe its about the future of industryenergy, aviation, healthcare, transportation, manufacturing. Its about making the world work better. GE is transforming itself to become the world s premier digital industrial company, executing critical outcomes for our customers. The salary range for this position is 88,800USD - 101,000USD. The specific salary offered to a candidate may be influenced by a variety of factors including the candidates experience, their education, and the work location. In addition, this position is eligible for a performance bonusvariable incentive compensation. Available benefits include Health, Medical, Vision, 401K, Paid Leave Additional Information GE offers a great work environment, professional development, challenging careers, and competitive compensation. GE is an Equal Opportunity Employer . Employment decisions are made without regard to race, color, religion, national or ethnic origin, sex, sexual orientation, gender identity or expression, age, disability, protected veteran status or other characteristics protected by law. GE will only employ those who are legally authorized to work in the United States for this opening. Any offer of employment is conditioned upon the successful completion of a drug screen (as applicable). Relocation Assistance Provided No This is a remote position