Job description:
direct supply, inc. is seeking a qualified candidate to serve as a staff data engineer to work with a team of engineers and architects to design data driven solutions, and establish robust data pipelines and services in milwaukee, wi. duties include: provide technical direction and mentoring of a small data engineering project team, to design solutions ensuring industry best sdlc practices; identify new development processes that improve the predictability and quality of projects; create, build and deploy robust data structures and pipelines to support analysis and decision making; provide high-level technical analysis and design as new projects go through the ideation phase; collaborate with end users and peers to understand requirements, formulate use cases, and translate into an effective technical solution; ownership of the design and delivery of key components of a large-scale data platform; build and deploy data warehouses and etl and elt applications; participate in global data strategy; design data integration pipeline architecture and infrastructure required for reporting and data analysis; use the scrum development process to deliver software solutions; coordinate integration testing and debugging of software components; understand system architecture and integration of new functionality. minimum qualifications: the minimum entry requirements for the staff data engineer position is a bachelors degree (or u.s. equivalent) in computer science, engineering, mathematics or a related field plus 5 years data engineering or business intelligence experience which must include 5 years of each of the following (and can be gained concurrently): working with enterprise data management technologies such as database and etl technologies; writing complex queries across large data sets; configuring, managing, and monitoring cloud data solutionsapplications; using python and a module for structured data processing such as spark sql. pre-employment drug test required. candidate must have references for work experience that confirm experience. candidates will also be subject to a criminal background check, and may be rejected if criminal convictions are substantially related to the position applied for, in accordance with applicable law. for more information, contact or reply by rsum to megan thull, senior hr generalist, direct supply, inc., 7301 w. champions way, milwaukee, wi 53223 (phone) (e-mail) job to be performed in the location listed. generous benefit package available. click here to learn more. direct supply, inc. and its u.s. subsidiaries are equal opportunity and affirmative action employers committed to diverse workforces. 2013 to 2023 direct supply, inc. all rights reserved.

Resume:
<<summaryobtain a challenging career in information technology with an aim to enhance and promote my skills to blend with rapidly growing technology. summary over 13 + years of technical experience in analysis, design, development, management and implementation of data warehousing and bi solutions at enterprise level. experience in designing and maintaining data warehouse. proficient in designing etl to load tables from different sources. extensive experience in c++, c#, perl, /sql. experience in working and administering mpp databases like aster. experience in installing and working with hortonworks hadoop environment (hdp stack 2.3.4). experience in archiving click stream data to hadoop and writing pig and hive scripts to format the data and deduce meaningful information from the logs stored, per business requirement. experience working with the postgresql(aster data). extensive experience with data warehousing olap applications, star and snowflake schemas designs/implementation. extensive experience loading data (etl) into sql server databases using t-sql and ssis packages. experience in rdbms concepts, database management systems, database physical and logical design, data mapping, table normalization, creating db diagrams, oltp, olap. expertise with developing sql scripts and performance tuning expertise in designing, developing, architecture, administration and implementation of business intelligence. data warehouse applications under different environments core focus on data warehousing and etl tools, obiee/siebel analytics. strong knowledge of data models (star schema and snow flake schema). experience in providing end-to-end business intelligence solution by dimensional modeling design, developing and configuring obiee repository (rpd), interactive dashboards, obiee answers, security implementation, analytics metadata objects, web catalog objects (dashboard, pages, folders, reports) and scheduling ibots. expert in designing, developing, architecture, administration and implementation of business intelligence very good in understanding the business logics and documentation and troubleshooting/analysis of data. experience in analyzing existing reports and migrating them from hyperion to obiee. very good understanding of xml with its validation, transformation and manipulation excellent communication skills, both written and verbal. a team player, capable of integrating with and developing effective workgroups. enthusiastic to learn new technologies and fast adaptability to new platforms and environment. organized and detailed[job title]with proven history supporting complex business intelligence projects. collaborative team player to partner cross-functionally to deliver solutions. offering more than[number]years of experience in testing and troubleshooting databases. solution-focused data warehousing specialist with[number]years of experience working in[industry]sector. technically-savvy and proficient in data analysis, team support and process improvements.[job title]with strong background in data warehouse development and management. talented at[skill],[skill]and[skill]. known for critical thinking skills and[software]expertise. ambitious, career-focused job seeker, anxious to obtain an entry-level[job title]position to help launch career while achieving company goals. skills technical skills languages : /sql, transact-sql (t-sql) , unix , pythontools and technologies : microsoft visual studio 2008/2013, microsoft visio, etl manager, eden (amazon etl tools), autosys, hadoop, pig, hivedatabases : -sql server 2005/2008/, /sql, oracle 9i, oracle10g, aster data (mpp analytic platform), prestoreporting tools : obiee 10.x, hyperion 8.5, sqlplus, sqlloader, sql developer, aqua studio.relational databasesanalysis and modelingrequirements gatheringdata warehousinggood work ethicpeople skills team buildingdata managementproblem resolution experience big data engineer,-cognizant technology solutions– ,redshift, aws s3, emr, edp , dynamo db, hive, presto, amazon internal tools ( hoot, datanet, cradle) , unix, pythonactive member of the chronicle team to build data solutions to onboard metrics to tursimo applicationresponsible for designing, developing, scaling and maintaining redshift cluster to process 1200+ kpi metrics for retail and 3p applicationdesigning, developing, scaling and maintaining emr cluster to process hive scripts to parquet files to develop data model for the query engine layerexecuted and managed high level, time critical projects to generate free cash flow for the teamdeveloped python scripts to automate manual and repetitive engineering tasksdeveloped redshift clusters to implement sdpp policy for amazon private brandsdata warehouse developer, 06/2012- 09/201622nd century technologies– ,tools: aster data, autosys, perl, unix, oracle 10g, hortonworks hadoop (hdp 2.3.4), pig, hive, hbase, sqoop,ambariactive member of the data warehouse team for developing and maintaining etl process for the discovery data warehouseactive member of the etl team for developing a new edw for the re-vamped bn.comdesigned and developed ssis packages for the etl processes through sql server 2013 business intelligence development studioresponsible for designing ,developing and maintaining etl process to load the aster database a massively parallel (mpp) analytic platformmaintained and enhanced business intelligence systems to convert secure and manage dataflow into the data warehouse systemsexpertise with developing sql scripts and performance tuning for new and existing daily etl processinvolved in maintaining health of the database and scheduling scripts to send out alerts in case of any discrepancies’involved in designing and implementing shell scripts to archive historical click stream data to hadoop ecosystem for further analysisdeveloped scripts to move data from hdfs to rdbms and vice-versa using sqoopdeveloped scripts in analyzing and transforming data with pig and hiveevaluated etl applications to support overall performance and improvement opportunitiesworked closely with the email marketing team in designing and developing the feeds at different granular levels for email targeting campaignsexpertise in analyzing data quality checks using shell scriptsworked closely with the business analyst and build data marts and summary tables to ease their access to the data warehouseresponsible for gathering data requirements analysis, design, development, testing and implementation of data warehouse solutionsimplemented and validated automating feeds received from external party vendorsautomated the validation scripts of all exports that are generated out of the data warehouseinvolved in all phases of data mart creation of various business units across the companyworked with various aster sql-mr functions to analyze clickstream and device and digital activity data and generated summary tables to analyze the kpi of the data available.data engineer/bi developer, 01/2010- 05/2012amazon.com–city,state,tools: eden (amazon etl tool), obiee, perl, unix, oracle 9i/10g, hyperion 8.5active member of the data warehouse team for building a new data warehouse on amazon framework, maintain existing data warehouse which is still currentinvolved in all phases of the application development from business requirements analysis, design, development, and testing of the data warehousewrote the design document for converting existing legacy data into new structuresresponsible in designing, monitoring, troubleshooting, debugging, testing job/workflow/dataflow to load data from multiple data sources for load into a custom reporting data martresponsible for modifying of all the three layers in the obiee rpdresponsible for the development of custom reports and dashboards in obieedeveloped and delivered technical mapping documentationsdesigned and executed test plans to validate data and load validationresponsible in designing, validating and delivering daily, weekly and quarterly reports from the new structuresdesigned unix and sql scripts to handle the daily feeds we receive and load them into tablesresponsible for data list processing for direct and email campaigns ,process reporting, maintaining prospect databases, maintaining suppression data, ensuring process documentation and improvement, and providing data to other departments on requestresponsible for designing metadata, rpd and exposing business structures to various dashboards that were designed on obieecreate periodic and ad-hoc reports using transact sql stored procedures, obiee, excel, and ms accesstook responsibility for discovery and documentation of processes to recover lost domain knowledge a result of staff attrition. education and trainingm.s:computer science,expected in 06/2009-syracuse university-syracuse,nygpa:status-gpa: 3.33bachelor of engineering:computer science,expected in 05/2007-osmania university-hyderabad,gpa:status-.