Job description:
role: lead data engineerlocation: remoteduration: long term 8 to 10 years of experience working in data engineering, business intelligence or related field delivering large scale data platforms and services. ideal candidate will have the following skills: a successful history of manipulating, processing and extracting value from large, disconnected datasets. expertise in data modeling, data access and data storage techniques. the candidate should have foundational knowledge of dimensional modeling to build a data warehouse strong experience building transformational logic using sql on relational sql and nosql databases. skills using dbt framework for data transformation is plus robust programming skills and strong experience with python to ingest, transform and load the data experience building and optimizing big data data pipelines, architectures and data sets using tools like airflow. experience with aws cloud services: ec2, emr, rds, redshift

Resume:
<<summaryobtain a challenging career in information technology with an aim to enhance and promote my skills to blend with rapidly growing technology. summary over 13 + years of technical experience in analysis, design, development, management and implementation of data warehousing and bi solutions at enterprise level. experience in designing and maintaining data warehouse. proficient in designing etl to load tables from different sources. extensive experience in c++, c#, perl, /sql. experience in working and administering mpp databases like aster. experience in installing and working with hortonworks hadoop environment (hdp stack 2.3.4). experience in archiving click stream data to hadoop and writing pig and hive scripts to format the data and deduce meaningful information from the logs stored, per business requirement. experience working with the postgresql(aster data). extensive experience with data warehousing olap applications, star and snowflake schemas designs/implementation. extensive experience loading data (etl) into sql server databases using t-sql and ssis packages. experience in rdbms concepts, database management systems, database physical and logical design, data mapping, table normalization, creating db diagrams, oltp, olap. expertise with developing sql scripts and performance tuning expertise in designing, developing, architecture, administration and implementation of business intelligence. data warehouse applications under different environments core focus on data warehousing and etl tools, obiee/siebel analytics. strong knowledge of data models (star schema and snow flake schema). experience in providing end-to-end business intelligence solution by dimensional modeling design, developing and configuring obiee repository (rpd), interactive dashboards, obiee answers, security implementation, analytics metadata objects, web catalog objects (dashboard, pages, folders, reports) and scheduling ibots. expert in designing, developing, architecture, administration and implementation of business intelligence very good in understanding the business logics and documentation and troubleshooting/analysis of data. experience in analyzing existing reports and migrating them from hyperion to obiee. very good understanding of xml with its validation, transformation and manipulation excellent communication skills, both written and verbal. a team player, capable of integrating with and developing effective workgroups. enthusiastic to learn new technologies and fast adaptability to new platforms and environment. organized and detailed[job title]with proven history supporting complex business intelligence projects. collaborative team player to partner cross-functionally to deliver solutions. offering more than[number]years of experience in testing and troubleshooting databases. solution-focused data warehousing specialist with[number]years of experience working in[industry]sector. technically-savvy and proficient in data analysis, team support and process improvements.[job title]with strong background in data warehouse development and management. talented at[skill],[skill]and[skill]. known for critical thinking skills and[software]expertise. ambitious, career-focused job seeker, anxious to obtain an entry-level[job title]position to help launch career while achieving company goals. skills technical skills languages : /sql, transact-sql (t-sql) , unix , pythontools and technologies : microsoft visual studio 2008/2013, microsoft visio, etl manager, eden (amazon etl tools), autosys, hadoop, pig, hivedatabases : -sql server 2005/2008/, /sql, oracle 9i, oracle10g, aster data (mpp analytic platform), prestoreporting tools : obiee 10.x, hyperion 8.5, sqlplus, sqlloader, sql developer, aqua studio.relational databasesanalysis and modelingrequirements gatheringdata warehousinggood work ethicpeople skills team buildingdata managementproblem resolution experience big data engineer,-cognizant technology solutions– ,redshift, aws s3, emr, edp , dynamo db, hive, presto, amazon internal tools ( hoot, datanet, cradle) , unix, pythonactive member of the chronicle team to build data solutions to onboard metrics to tursimo applicationresponsible for designing, developing, scaling and maintaining redshift cluster to process 1200+ kpi metrics for retail and 3p applicationdesigning, developing, scaling and maintaining emr cluster to process hive scripts to parquet files to develop data model for the query engine layerexecuted and managed high level, time critical projects to generate free cash flow for the teamdeveloped python scripts to automate manual and repetitive engineering tasksdeveloped redshift clusters to implement sdpp policy for amazon private brandsdata warehouse developer, 06/2012- 09/201622nd century technologies– ,tools: aster data, autosys, perl, unix, oracle 10g, hortonworks hadoop (hdp 2.3.4), pig, hive, hbase, sqoop,ambariactive member of the data warehouse team for developing and maintaining etl process for the discovery data warehouseactive member of the etl team for developing a new edw for the re-vamped bn.comdesigned and developed ssis packages for the etl processes through sql server 2013 business intelligence development studioresponsible for designing ,developing and maintaining etl process to load the aster database a massively parallel (mpp) analytic platformmaintained and enhanced business intelligence systems to convert secure and manage dataflow into the data warehouse systemsexpertise with developing sql scripts and performance tuning for new and existing daily etl processinvolved in maintaining health of the database and scheduling scripts to send out alerts in case of any discrepancies’involved in designing and implementing shell scripts to archive historical click stream data to hadoop ecosystem for further analysisdeveloped scripts to move data from hdfs to rdbms and vice-versa using sqoopdeveloped scripts in analyzing and transforming data with pig and hiveevaluated etl applications to support overall performance and improvement opportunitiesworked closely with the email marketing team in designing and developing the feeds at different granular levels for email targeting campaignsexpertise in analyzing data quality checks using shell scriptsworked closely with the business analyst and build data marts and summary tables to ease their access to the data warehouseresponsible for gathering data requirements analysis, design, development, testing and implementation of data warehouse solutionsimplemented and validated automating feeds received from external party vendorsautomated the validation scripts of all exports that are generated out of the data warehouseinvolved in all phases of data mart creation of various business units across the companyworked with various aster sql-mr functions to analyze clickstream and device and digital activity data and generated summary tables to analyze the kpi of the data available.data engineer/bi developer, 01/2010- 05/2012amazon.com–city,state,tools: eden (amazon etl tool), obiee, perl, unix, oracle 9i/10g, hyperion 8.5active member of the data warehouse team for building a new data warehouse on amazon framework, maintain existing data warehouse which is still currentinvolved in all phases of the application development from business requirements analysis, design, development, and testing of the data warehousewrote the design document for converting existing legacy data into new structuresresponsible in designing, monitoring, troubleshooting, debugging, testing job/workflow/dataflow to load data from multiple data sources for load into a custom reporting data martresponsible for modifying of all the three layers in the obiee rpdresponsible for the development of custom reports and dashboards in obieedeveloped and delivered technical mapping documentationsdesigned and executed test plans to validate data and load validationresponsible in designing, validating and delivering daily, weekly and quarterly reports from the new structuresdesigned unix and sql scripts to handle the daily feeds we receive and load them into tablesresponsible for data list processing for direct and email campaigns ,process reporting, maintaining prospect databases, maintaining suppression data, ensuring process documentation and improvement, and providing data to other departments on requestresponsible for designing metadata, rpd and exposing business structures to various dashboards that were designed on obieecreate periodic and ad-hoc reports using transact sql stored procedures, obiee, excel, and ms accesstook responsibility for discovery and documentation of processes to recover lost domain knowledge a result of staff attrition. education and trainingm.s:computer science,expected in 06/2009-syracuse university-syracuse,nygpa:status-gpa: 3.33bachelor of engineering:computer science,expected in 05/2007-osmania university-hyderabad,gpa:status-.