For the given job description <<Role: Lead Data EngineerLocation: RemoteDuration: Long Term 8 to 10 years of experience working in data engineering, business intelligence or related field delivering large scale data platforms and services. Ideal candidate will have the following skills: A successful history of manipulating, processing and extracting value from large, disconnected datasets. Expertise in data modeling, data access and data storage techniques. The candidate should have foundational knowledge of dimensional modeling to build a data warehouse Strong experience building transformational logic using SQL on relational SQL and NoSQL databases. Skills using DBT framework for data transformation is plus Robust programming skills and strong experience with Python to ingest, transform and load the data Experience building and optimizing big data data pipelines, architectures and data sets using tools like Airflow. Experience with AWS cloud services: EC2, EMR, RDS, Redshift>> the resume: <<SummaryInvolving in various projects related to Data Modeling, Data Analysis, Design and Development for Data warehousing environments. Practical understanding of the Data modeling (Dimensional & Relational) concepts like Star-Schema Modeling, Snowflake Schema Modeling, Fact and Dimension tables. Comprehensive knowledge and experience in process improvement, normalization/de-normalization, data extraction, data cleansing, data manipulation. Exceptional troubleshooting skills with ETL Technologies.
HighlightsHadoop, Hive, Avro, Kafka, MapReduce, Looker
Programming Languages: SQL, Java, Scala, PHP, Shell Script, HTML
Database Tools: Aster Database, PostgreSQL, MySQL
Operating Systems: Linux, Unix, Microsoft Windows
Experience08/2012toCurrentData EngineerAvanade|Greenville,NC,Experience with full development cycle of a Data Warehouse, including requirements gathering, design, implementation, and maintenance.Data modeling based on Kimball methodology, developed and architected ETL processes for different projects (RMA, inventory, purchase order etc.) Re-engineer some of the current ETL processes to streamline the data acquisition and integration process using our homegrown ETL tools.Built event-driven data pipeline that comprises multiple steps to gather high volume and velocity data from both push based and pull based sources, which includes design and implement web service to collect data (JSON object over http request), convert data in JSON format into Avro then feed into Kafka, land data in Kafka on Hadoop and Aster.Designed and built Looker API using Scala, which makes other teams access the data in data warehouse more easily and gracefully.Establish and maintain SQL queries and routines.Write ad-hoc queries based upon the schema understanding for diverse needs of our business users.02/2012to03/2012Java InternDominion Enterprises|Fredericksburg,VA,Implemented code for small features & bug-fixes in Java.06/2011to09/2011PHP DeveloperMeetoncruise|City,STATE,Implemented the back-end logic using PHP.Utilized JQuery and AJAX to provide dynamic and interactive user interface.Designed and implemented data model in MySQL database to support the website.
EducationExpected in2012totoMaster of Science|Electrical and Computer EngineeringPolytechnic Institute of New York University,Brooklyn,NYGPA:Electrical and Computer EngineeringExpected in2010totoBachelor of Science|Automation EngineeringNanjing University of Aeronautics and Astronautics,Nanjing,JiangsuGPA:Automation Engineering
Skillsstreamline, ad, AJAX, API, data acquisition, Data modeling, data warehouse, Database, engineer, ETL, features, HTML, http, PHP, inventory, Java, JQuery, JSON, Linux, logic, access, Microsoft Windows, MySQL, Operating Systems, PostgreSQL, processes, Programming, requirements gathering, Shell Script, SQL, Unix, user interface, website>>. The result is, 

Fit assessment: Good Fit