SummaryInvolving in various projects related to Data Modeling, Data Analysis, Design and Development for Data warehousing environments. Practical understanding of the Data modeling (Dimensional Relational) concepts like Star-Schema Modeling, Snowflake Schema Modeling, Fact and Dimension tables. Comprehensive knowledge and experience in process improvement, normalization de-normalization, data extraction, data cleansing, data manipulation. Exceptional troubleshooting skills with ETL Technologies. HighlightsHadoop, Hive, Avro, Kafka, MapReduce, Looker Programming Languages SQL, Java, Scala, PHP, Shell Script, HTML Database Tools Aster Database, PostgreSQL, MySQL Operating Systems Linux, Unix, Microsoft Windows Experience08 2012toCurrentData EngineerAvanade Greenville,NC,Experience with full development cycle of a Data Warehouse, including requirements gathering, design, implementation, and maintenance.Data modeling based on Kimball methodology, developed and architected ETL processes for different projects (RMA, inventory, purchase order etc.) Re-engineer some of the current ETL processes to streamline the data acquisition and integration process using our homegrown ETL tools.Built event-driven data pipeline that comprises multiple steps to gather high volume and velocity data from both push based and pull based sources, which includes design and implement web service to collect data (JSON object over http request), convert data in JSON format into Avro then feed into Kafka, land data in Kafka on Hadoop and Aster.Designed and built Looker API using Scala, which makes other teams access the data in data warehouse more easily and gracefully.Establish and maintain SQL queries and routines.Write ad-hoc queries based upon the schema understanding for diverse needs of our business users.02 2012to03 2012Java InternDominion Enterprises Fredericksburg,VA,Implemented code for small features bug-fixes in Java.06 2011to09 2011PHP DeveloperMeetoncruise City,STATE,Implemented the back-end logic using PHP.Utilized JQuery and AJAX to provide dynamic and interactive user interface.Designed and implemented data model in MySQL database to support the website. EducationExpected in2012totoMaster of Science Electrical and Computer EngineeringPolytechnic Institute of New York University,Brooklyn,NYGPA Electrical and Computer EngineeringExpected in2010totoBachelor of Science Automation EngineeringNanjing University of Aeronautics and Astronautics,Nanjing,JiangsuGPA Automation Engineering Skillsstreamline, ad, AJAX, API, data acquisition, Data modeling, data warehouse, Database, engineer, ETL, features, HTML, http, PHP, inventory, Java, JQuery, JSON, Linux, logic, access, Microsoft Windows, MySQL, Operating Systems, PostgreSQL, processes, Programming, requirements gathering, Shell Script, SQL, Unix, user interface, website  SEP  Job Description I am actively seeking an experienced Data Engineer to join an innovative SaaS company within the AI AdTech space. The ideal candidate is passionate about data, is highly self-motivated, enjoys collaborative work environments, and has a seasoned background in software development. Requirements At least 8 years of professional engineering experience At least 5 years of hands-on data engineering experience with ScalaSpark At least 3 years of hands-on software development experience with Java Spring for REST API development Highly proficient in designing, building, deploying, etc. new ETL data pipelines, databases, features and systems Expert level Spark knowledge Experience with Relational databases Cloud technology experience (AWS is highly preferred) B.S. or higher in Computer Science, or related field Bonus Points Background working in a SaaS product based environment Experience andor exposure to the full software development life cycle (SDLC) of a product Lead andor mentorship experience This is a full time, direct hire position. The comp benefits package includes a base, annual bonus, unlimited PTO, healthcare coverage, and much more! This position is fully remote anywhere in the United States, except California. Visa sponsorship is not available at this time

ATS compatibility: Good Fit (score: 83.3)