Job description:
title: sr. data engineerlocation: austin, txduration: 6 monthspay rate: $65hr - $70hr on w2 requirements:bachelors degree in computer science or related field plus 4+ years of relevant work experience or a master's degree plus 2+ years of relevant work experience or a phd plus 0-1 years of relevant experiencein lieu of a degree, qualified candidates would require 8+ years of relevant professional experienceexcellent with sqlexcellent programming skills in python and ideally demonstrating an aptitude via experience with multiple languagesexcellent understanding of patterns for data ingest into data warehouse, ingest, cleansing, standardizing, etc., in addition to different data structures like normalized, denormalized, starexcellent experience supporting snowflake data warehouse, including snowpipe (including streams), tasks, transformations, views, dynamic tables. this should include advanced skills in ensuring efficient utilization of snowflake compute and the ability to optimize workloads and warehousebroad experience with cloud paas capabilities, ideally aws cloudwatch, lambda, step functions, snssqs, dynamodb, etc.experience utilizing reporting and data insights toolsexperience in supporting analytics teams data needs, in addition to customer and business reporting. what you'll be doing:provides data engineering support for areas such as finance, sales, business intelligence, product development andor other business usersworks with data consumers and project managers to determine logical and physical database designs for analytics modelscreates and maintains optimal data pipeline architecturesensures architectures are aligned with and support business requirements;ensures that required data is available, can be trusted and is readily accessible by those who need itinfluences the data infrastructure roadmapidentifies, designs and implements internal data management process improvementsplays a key role in application development projects to evolve the companys database architecture and designworks with internal and external data providers on data validation, providing feedback and making customized changes to data feeds and data mappings for analytical and operational useautomates manual processes, transforming them into repeatable capabilitiesworks with fellow team members to ensure design, development and execution align with and support adjacencies and adhere to established architectural standards. top 5 must haves:excellent with sqlexcellent programming skills in python and ideally demonstrating an aptitude via experience with multiple languagesexcellent understanding of patterns for data ingest into data warehouse, ingest, cleansing, standardizing, etc., in addition to different data structures like normalized, denormalized, star;excellent experience supporting snowflake data warehouse, including snowpipe (including streams), tasks, transformations, views, dynamic tables. this should include advanced skills in ensuring efficient utilization of snowflake compute and the ability to optimize workloads and warehousebroad experience with cloud paas capabilities, ideally aws cloudwatch, lambda, step functions, snssqs, dynamodb, etc.

Resume:
<<professional summaryhighly skilled software development professional bringing more than 4 years in software design, development and integration. offering advanced knowledge of cloud components, data ingestion, and java/python/javascript programming languages. skills python, java, html, css, javascript;application frameworks: gcp bigquery, pub/sub, apache beam, k8s, stackdriver, grafana, tableau, sumo logic, datadog, new relic, apigee, angular, node.js, spring mvc, spring boot, spring data, spring cloud, netflix oss,jpa, maven, tomcat, hibernate, express, redis, postgresql, mongodb, docker, restful api, nginx, tensorflow, nlp,react, git, apache bench, postmanapacheapicookingcssdatabasedebuggingdeliveryengineeretlfunctionalgcphtmljavajavascriptleadershiplogicdirectormarketmongodbmvcnlposspostgresqlpricingprogrammingprogresspythonqualityexpressreal-timesoftware developerstableautablestomcatworkshops work history software developer, 12/2018-currentmaxar technologies ltd– ,designed and deployed the first data ingestion pipeline on google cloud platform (gcp) by using cloud pub/sub, cloud dataflow, cloud dataprep, bigquery, and stackdriver to collect, store and monitor event data streaming; the ingestion pipeline helps data scientist team on collecting the order level data/events, iot devices status without touching production database and support real-time data collecting designed and implemented ingestion service and schemas store by using typescript; the ingestion service and schemas store helped the entire team automatic generating unpacking pipeline and secondary table for all internal consumers designed and implemented javascript sdk & ingest url to publish events from backend service, iot devices, and 3rd party service; using jwt token as authorization, apigee as api key management tool collaborated with data scientists team to collect requirements of demand prediction models and delivered etl tables by using bigquery apache beam(dataflow) and cloud dataprep; supported 2 data scientist/engineer team, 4 ml models including order preparation, dynamic pricing, etc implemented kpi dashboards for cross-functional leadership to monitor data growth weekly and for 4-5 teams of data scientists to monitor data ingestion and data quality daily.used tableau and grafana to build data models and visualize data hosting millions of daily data entries led a team of 4 software developers to collect user requirements from the factory operations team, translated the business to technology need to the services team and ensured consensus, spearheaded the build of grafana dashboard to track time-series metrics from iot device.the dashboard was used by the factory team to monitor progress and by the cross-functional data scientist team to build on models built iot device alerting and monitoring system prototypes by ingesting data, customizing apache beam job to run and normalize data, and created real-time alerting functions with zero delay; collaborated with 2 pms to understand user requirements, owned the end-to-end prototype build in 2 weeks, demoed in front of 10+ director-level board members decoupled and migrated the monolithic backend service to microservices by using node.js, restful api designed and implemented the market microservice and database to support food cooking and delivery service by using postgresql, knex, restful api, express.js, and typescript onboarded 100+ incoming software developers nationwide; revamped and expanded knowledge transfer document, conducted workshops and 1:1s to help new joiners set up and understand environments, owned debugging and answered questions.programmer, 03/2016- 12/2018new jersey institute of technology– ,designed and implemented an auto-test-system(ats): handle the entire process including design, development, implementation, and integration designed test packages (data checker, autographing tool, auto-input-data-file module, testing interface, and results checker) based on different standard requirements, ensure accuracy and sustainability of test results. education master of science:,expected in 05/2014-syracuse university-syracuse,nygpa:status-bachelor of science:electrical, electronics engineering technologies,expected in 07/2011-inner mongolia university of science & technology-,gpa:status- skills python, java, html, css, javascript;aapplication frameworks: gcp bigquery, pub/sub, apache beam, k8s, stackdriver, grafana, tableau, sumo logic, dataddog, new relic, apigee, angular, node.js, spring mvc, spring boot, spring data, spring cloud, netflix oss,jjpa, maven, tomcat, hibernate, express, redis, postgresql, mongodb, docker, restful api, nginx, tensorflow, nlp,rreact, git, apache bench, postman,apache, api, cooking, css, database, debugging, delivery, engineer, etl, functional, gcp, html, java, javascript, leadership, logic, director, market, mongodb, mvc, nlp, oss, postgresql, pricing, programming, progress, python, quality, express, real-time, software developers, tableau, tables, tomcat, workshops.