SummaryStrong IT experience in AWS cloud computing, Bigdata Data warehousing.Strong Business Domain Knowledge in Sales Segmentation Territory Planning.Strong Coding SQL experience in Python and RedshiftHaving an experience in Agile and deliver the results based on stories and task assigned on the sprint.Implementation Knowledge in Server-less Architecture using AWS Cloud Computing.Having Good Hands on experience in GIT as well as CI CD pipeline Integration.Having Good Hands on Experience in building Data Model based on requirements. SkillsProgramming Languages Java, Python, Unix, Unix Shell ScriptingCloud Technologies Amazon Web Services (AWS)Version Control AWS CodeCommit, GIT, GitHub RepositoriesContinuous Integration Continuous Delivery(CI CD) AWS CodeDeploy AWS CodePipelineDatabases and SQL Redshift, Oracle, Netezza, NoSQL (DDB Elasticsearch)Big Data Technologies Hadoop, Hive, Ozzie, AirFlow, Spark, PySpark, Scoop, Flume Experience01 2018toCurrentSenior Data EngineerSplunk Bloomington,MN,Collaborated with product owners to gather requirement to help build a solution for Sales Segmentation.Identified key use cases and associated reference architectures for market segments and industry verticals.Worked as part of project teams to coordinate database and pipeline development and determine project scopes and limitations.Collaborated with solution architects to define database and analytics engagement strategies for operational territories and key accounts.Developed and managed enterprise-wide big data environments.Specified user access levels for each database segment to protect database integrity and company information.Developed and implemented security initiatives to protect important company data.Established hardware requirements and devised storage capacity solutions and choose wisely on the AWS services by outweigh the requirement and business use-case.12 2015to12 2017Big Data EngineerNike Inc Gurnee,IL,Perform as a Big Data Developer and work in various phases like Data Ingestion, Data Integration and Transformation.Create a Sqoop import command and pull the data (both tables and all tables in DB s) from MySQL DB to HDFS as part of Data IngestionCreates a MapReduce Programs as well as Spark programs to parse, analyze and implement the solutions based on its customer need.Perform operations to filter the records from DB, boundary query, incremental update or insert in the Sqoop import commands.Perform operations to insert the data directly to Hive tables, Change the delimiters and end line character and Change the formats like textFile, AvroDataFile, ORC file into HDFS systems using Sqoop Import commands.Perform Sqoop Eval function to evaluate the data in MYSQL.Perform Sqoop Export function to export the data from HDFS and loaded it into MYSQL and understand the delimiter of the file, define the no of mapper to perform, etc.Create a Flume config file to ingest the data from various source systems like (Spool Directory, NetCat, Exec, Sequence, etc.) and loaded it into Avro, HDFS etc.Define a proper channels(Memory, File ,etc.) and loaded all the data comes from Source to Sinks.Used the interceptor to modify the data comes from Source like Filtering (Regex), Include the Timestamp, Search and Replace, etc.Create a MapReduce Program using Eclipse IDE and execute it through jar file.Create a Mapper Class and using Map method generate the key value pair as (node_with_date, system utilization) by writing in Context application.Create a Reducer Class and using reduce method, generate the final output of system utilization per node_with_date.Implements custom based writable class to get the two values in the mapOutputValue class.Implements custom based partitioner class to assign a appropriate data to the right reducer(Basically try to achieve multi-level group by function with MR limitations).Implements Pattern Matching Logic for semi-structured Data and routed the good and bad records separately.Create a custom based input format as well as record reader to parse the XML file.Hands-on in creating the Broadcast Variables.Hands-on in SparkSQL, DataFrame creation, DF via class object in Scala, Convert DF to RDD, TempTable Schema creation and So on.09 2009to04 2015ETL DeveloperAllegis Group Jacksonville,FL,Created and implemented complex business intelligence solutions.Created conceptual, logical and physical data models for use in different business areas.Developed and managed enterprise-wide data analytics environments.Identified, protected and leveraged existing data.Monitored multiple databases to keep track of all company inventory.Assisted maintenance team with completion of preventive maintenance and unscheduled service needs.Monitored installations to ensure compliance with local codes and industry best practices. Education and TrainingExpected intotoMaster of Science Information TechnologyAmity University,Noida, India,GPA Expected in05 2008totoBachelor of Engineering College of Engineering Guindy, Anna University,Chennai, India,GPA  SEP  ROR Partners is a rapidly growing, client-driven digital marketing and data company. We offer proven marketing solutions to a variety of vertical industries on a nationwide basis. ROR is seeking a Principal Data Engineer to serve as a key data architect and team leader on our data engineering team. The successful candidate will have demonstrated deep understanding and passion for designing and implementing robust ETL and ELT data pipelines. Position is remote and reports to the VP, Engineering. Salary is 170K to 195K and is determined by factors such as location, experience, and expertise. What you will doBuild, maintain, and administer our Snowflake data warehouse using Data Build Tool (dbt)Implement and maintain data pipelines between various operational systems and our data warehouse using Python, Airflow and integration platformsCreate and maintain documentation of data architectureCollaborate with internal and external stakeholders to ensure that data requirements are addressedMentor and lead other data engineering team members and participate in peer design and code reviewsShip production-quality features independentlyWork efficiently and productively in a remote-first work environmentCommunicate and collaborate effectively, both verbally and in writingLearn independently - keep up to date with developments in the field QualificationsWhat we are looking forHistory of professional experience shipping production quality code independentlyAbility and desire to lead and mentor a team of data engineersExpertise with SQL and cloud-based analytical data warehouses (Snowflake preferred)Expertise building end-to-end data pipelines using Airflow and dbt (data build tool) or comparable technologiesDeep understanding of ETL and ELT patterns and best practicesStrong data modeling skills and familiarity with the Kimball data warehousing methodologyExperience writing Python code for data processingDesire to continually keep up with advancements in data engineering practicesExperience conducting design and code reviewsStrong analytical skills and independent learning styleExperience with git and use of the command line requiredExperience with AWS and CloudFormation, or comparable cloud services and IaC tools preferredExperience with Docker and Docker Compose preferredSubject matter familiarity with digital marketing and digital activation is preferred EducationTrainingRequired BS Degree in computer science or related STEM field Experience8 years of experience in data science, software engineering or related technical fields. ROR Partners is an Equal Opportunity Employer. ROR Partners policy is not to discriminate against any applicant or employee based on actual or perceived race, age, sex or gender (including pregnancy), marital status, national origin, ancestry, citizenship status, mental or physical disability, religion, creed, color, sexual orientation, gender identity or expression (including transgender status), veteran status, genetic information, or any other characteristic protected by applicable federal, state or local law. ROR Partners also prohibits harassment of applicants and employees based on any of these protected categories. ROR Partners will provide accommodations to applicants as needed.