For the given job description <<Title: Azure Data Engineer Location  Seattle, WA - In-Office Days: Monday, Tuesday, and ThursdayDuration  12 months Job Description:Independently design and develop programs and tools to support data pipelines including ingestion, curation, and provisioning of data for analytics, reporting and data science. Deliver key, complex business capabilities and platform features. Deliver high quality software using AgileScrum development methodologies. Identify and drive operational improvements for the team's data platform services.
ResponsibilitiesShould have experience with Azure Databricks, Spark, and Azure Data Factory Should have experience operationalizing production pipelines4 years of software development experience using Python  PySpark4 years of experience using software engineering fundamentals, including algorithm theory and data structures. 2 years of experience using CICD tools to build and deploy software systems.2 years of experience using relational and non-relational, NoSQL databases. 1 years of experience using Hadoop or Spark. 1 years of experience using data hygiene routines and models.Collaborate with development team, other Information Technology (IT) teams developer leads.Initiate process improvements for new and existing systems. Design, develop, implement, document, and test changes to an application subsystem.Code, test, debugs, documents, and implement complex software applications.Create more complex prototypes and ensure deliverables are high quality and meet user expectations.Support system and integration testing activities.Perform root cause analysis to identify permanent resolutions to software or business process issuesInitiate design reviews for new applications and adhere to software development standards. Coach, and mentor other team members.Perform cross-training and facilitate information sharing among team members.
>> the resume: <<SummaryObtain a challenging career in Information Technology with an aim to enhance and promote my skills to blend with rapidly growing technology. SUMMARY Over 13 + years of technical experience in analysis, design, development, management and implementation of Data warehousing and BI Solutions at Enterprise level. Experience in Designing and maintaining Data warehouse. Proficient in designing ETL to load tables from different sources. Extensive Experience in C, C++, C#, Perl, SQL, PL/SQL. Experience in working and administering MPP Databases like Aster. Experience in Installing and working with Hortonworks Hadoop Environment (HDP STACK 2.3.4). Experience in archiving click stream data to Hadoop and writing PIG and HIVE scripts to format the data and deduce meaningful information from the logs stored, per business requirement. Experience working with the PostgreSQL(Aster Data). Extensive experience with Data Warehousing OLAP applications, Star and Snowflake Schemas designs/implementation. Extensive experience Loading Data (ETL) into SQL Server Databases using T-SQL and SSIS packages. Experience in RDBMS Concepts, Database Management Systems, Database Physical and Logical design, Data Mapping, Table normalization, Creating DB Diagrams, OLTP, OLAP. Expertise with Developing SQL scripts and Performance Tuning Expertise in designing, developing, architecture, administration and implementation of Business Intelligence. Data Warehouse applications under different environments core focus on Data Warehousing and ETL tools, OBIEE/Siebel Analytics. Strong knowledge of Data Models (Star Schema and Snow Flake Schema). Experience in providing end-to-end business intelligence solution by dimensional modeling design, developing and configuring OBIEE Repository (RPD), Interactive Dashboards, OBIEE Answers, security implementation, Analytics Metadata objects, Web Catalog Objects (Dashboard, Pages, Folders, Reports) and scheduling iBots. Expert in designing, developing, architecture, administration and implementation of Business Intelligence Very good in understanding the business logics and documentation and troubleshooting/analysis of data. Experience in analyzing Existing reports and migrating them from Hyperion to OBIEE. Very good understanding of XML with its validation, transformation and manipulation Excellent Communication skills, both written and verbal. A team player, capable of integrating with and developing effective workgroups. Enthusiastic to learn new technologies and fast adaptability to new platforms and environment. Organized and detailed[Job Title]with proven history supporting complex business intelligence projects. Collaborative team player to partner cross-functionally to deliver solutions. Offering more than[Number]years of experience in testing and troubleshooting databases. Solution-focused Data Warehousing Specialist with[Number]years of experience working in[Industry]sector. Technically-savvy and proficient in data analysis, team support and process improvements.[Job Title]with strong background in data warehouse development and management. Talented at[Skill],[Skill]and[Skill]. Known for critical thinking skills and[Software]expertise. Ambitious, career-focused job seeker, anxious to obtain an entry-level[Job Title]position to help launch career while achieving company goals.
SkillsTECHNICAL SKILLSLanguages :SQL, PL/SQL, Transact-SQL (T-SQL) , Unix , PythonTools and Technologies : Microsoft Visual Studio 2008/2013, Microsoft Visio, ETL Manager, EDEN (Amazon ETL Tools), Autosys, Hadoop, PIG, HiveDatabases : Redshift, MS-SQL Server 2005/2008/, SQL, PL/SQL, Oracle 9i, Oracle10g, Aster Data (MPP Analytic Platform), PrestoReporting Tools : OBIEE 10.x, Hyperion 8.5, SQLPLUS, SQLLoader, SQL Developer, Aqua studio.Relational DatabasesAnalysis and ModelingRequirements GatheringData WarehousingGood Work EthicPeople SkillsTeam BuildingData ManagementProblem Resolution
ExperienceBig Data Engineer,-Cognizant Technology Solutions–Mason,OH,Redshift, AWS S3, EMR, EDP , Dynamo DB, Hive, Presto, Amazon Internal tools ( Hoot, Datanet, Cradle) , Unix, PythonActive Member of the chronicle team to build Data solutions to onboard metrics to Tursimo applicationResponsible for designing, developing, scaling and maintaining redshift cluster to process 1200+ KPI metrics for Retail and 3p applicationDesigning, developing, scaling and maintaining EMR cluster to process hive scripts to parquet files to develop data model for the Query engine layerExecuted and managed high level, time critical projects to generate Free Cash Flow for the teamDeveloped Python Scripts to automate manual and repetitive engineering tasksDeveloped Redshift clusters to implement SDPP policy for amazon Private BrandsData warehouse Developer,06/2012-09/201622Nd Century Technologies–Alexandria,VA,Tools: Aster Data, Autosys, Perl, UNIX, Oracle 10g, HORTONWORKS Hadoop (HDP 2.3.4), PIG, HIVE, HBASE, SQOOP,AmbariActive Member of the Data Warehouse team for developing and maintaining ETL process for the Discovery Data warehouseActive member of the ETL Team for developing a new EDW for the re-vamped bn.comDesigned and developed SSIS packages for the ETL processes through SQL Server 2013 Business Intelligence Development StudioResponsible for designing ,developing and maintaining ETL process to load the Aster Database a massively parallel (MPP) Analytic PlatformMaintained and enhanced Business Intelligence systems to convert secure and manage dataflow into the data warehouse systemsExpertise with Developing SQL scripts and Performance Tuning for New and existing Daily ETL processInvolved in maintaining health of the Database and scheduling scripts to send out alerts in case of any discrepancies’Involved in designing and implementing Shell scripts to archive historical click stream data to Hadoop Ecosystem for further analysisDeveloped Scripts to move data from HDFS to RDBMS and vice-versa using SQOOPDeveloped Scripts in analyzing and transforming Data with PIG and HiveEvaluated ETL applications to support overall performance and improvement opportunitiesWorked closely with the email marketing team in designing and developing the feeds at different granular levels for Email targeting campaignsExpertise in Analyzing data Quality checks using shell scriptsWorked closely with the Business analyst and build data marts and summary tables to ease their access to the data warehouseResponsible for gathering data requirements analysis, design, development, testing and implementation of data warehouse solutionsImplemented and validated automating feeds received from external party vendorsAutomated the validation scripts of all exports that are generated out of the Data warehouseInvolved in all phases of Data mart creation of various business units across the companyWorked with various Aster SQL-MR functions to analyze clickstream and device and digital activity data and generated summary tables to analyze the KPI of the data available.Data Engineer/BI Developer,01/2010-05/2012Amazon.com–City,STATE,Tools: EDEN (Amazon ETL Tool), OBIEE, Perl, UNIX, Oracle 9i/10g, Hyperion 8.5Active Member of the Data warehouse team for building a new data warehouse on Amazon Framework, maintain existing data warehouse which is still currentInvolved in all phases of the application development from business requirements analysis, design, development, and testing of the Data WarehouseWrote the design document for converting existing legacy data into new structuresResponsible in designing, monitoring, troubleshooting, debugging, testing job/workflow/dataflow to load data from multiple data sources for load into a custom reporting data martResponsible for modifying of all the three layers in the OBIEE RPDResponsible for the development of custom reports and dashboards in OBIEEDeveloped and delivered technical mapping documentationsDesigned and executed Test plans to validate data and load validationResponsible in Designing, validating and delivering Daily, Weekly and Quarterly reports from the new structuresDesigned Unix and sql scripts to handle the daily feeds we receive and load them into tablesResponsible for data list processing for direct and email campaigns ,process reporting, maintaining prospect databases, maintaining suppression data, ensuring process documentation and improvement, and providing data to other departments on requestResponsible for designing metadata, rpd and exposing business structures to various dashboards that were designed on OBIEECreate periodic and ad-hoc reports using Transact SQL, SQL Stored Procedures, OBIEE, Perl, MS Excel, and MS AccessTook responsibility for discovery and documentation of processes to recover lost domain knowledge 	a result of staff attrition.
Education and TrainingM.S:Computer Science,Expected in06/2009-Syracuse University-Syracuse,NYGPA:Status-GPA: 3.33Bachelor of Engineering:Computer Science,Expected in05/2007-Osmania University-Hyderabad,GPA:Status->>. The result is, Potential Fit

Fit assessment: Potential Fit