SummaryStrong IT experience in AWS cloud computing, Bigdata Data warehousing.Strong Business Domain Knowledge in Sales Segmentation Territory Planning.Strong Coding SQL experience in Python and RedshiftHaving an experience in Agile and deliver the results based on stories and task assigned on the sprint.Implementation Knowledge in Server-less Architecture using AWS Cloud Computing.Having Good Hands on experience in GIT as well as CI CD pipeline Integration.Having Good Hands on Experience in building Data Model based on requirements. SkillsProgramming Languages Java, Python, Unix, Unix Shell ScriptingCloud Technologies Amazon Web Services (AWS)Version Control AWS CodeCommit, GIT, GitHub RepositoriesContinuous Integration Continuous Delivery(CI CD) AWS CodeDeploy AWS CodePipelineDatabases and SQL Redshift, Oracle, Netezza, NoSQL (DDB Elasticsearch)Big Data Technologies Hadoop, Hive, Ozzie, AirFlow, Spark, PySpark, Scoop, Flume Experience01 2018toCurrentSenior Data EngineerSplunk Bloomington,MN,Collaborated with product owners to gather requirement to help build a solution for Sales Segmentation.Identified key use cases and associated reference architectures for market segments and industry verticals.Worked as part of project teams to coordinate database and pipeline development and determine project scopes and limitations.Collaborated with solution architects to define database and analytics engagement strategies for operational territories and key accounts.Developed and managed enterprise-wide big data environments.Specified user access levels for each database segment to protect database integrity and company information.Developed and implemented security initiatives to protect important company data.Established hardware requirements and devised storage capacity solutions and choose wisely on the AWS services by outweigh the requirement and business use-case.12 2015to12 2017Big Data EngineerNike Inc Gurnee,IL,Perform as a Big Data Developer and work in various phases like Data Ingestion, Data Integration and Transformation.Create a Sqoop import command and pull the data (both tables and all tables in DB s) from MySQL DB to HDFS as part of Data IngestionCreates a MapReduce Programs as well as Spark programs to parse, analyze and implement the solutions based on its customer need.Perform operations to filter the records from DB, boundary query, incremental update or insert in the Sqoop import commands.Perform operations to insert the data directly to Hive tables, Change the delimiters and end line character and Change the formats like textFile, AvroDataFile, ORC file into HDFS systems using Sqoop Import commands.Perform Sqoop Eval function to evaluate the data in MYSQL.Perform Sqoop Export function to export the data from HDFS and loaded it into MYSQL and understand the delimiter of the file, define the no of mapper to perform, etc.Create a Flume config file to ingest the data from various source systems like (Spool Directory, NetCat, Exec, Sequence, etc.) and loaded it into Avro, HDFS etc.Define a proper channels(Memory, File ,etc.) and loaded all the data comes from Source to Sinks.Used the interceptor to modify the data comes from Source like Filtering (Regex), Include the Timestamp, Search and Replace, etc.Create a MapReduce Program using Eclipse IDE and execute it through jar file.Create a Mapper Class and using Map method generate the key value pair as (node_with_date, system utilization) by writing in Context application.Create a Reducer Class and using reduce method, generate the final output of system utilization per node_with_date.Implements custom based writable class to get the two values in the mapOutputValue class.Implements custom based partitioner class to assign a appropriate data to the right reducer(Basically try to achieve multi-level group by function with MR limitations).Implements Pattern Matching Logic for semi-structured Data and routed the good and bad records separately.Create a custom based input format as well as record reader to parse the XML file.Hands-on in creating the Broadcast Variables.Hands-on in SparkSQL, DataFrame creation, DF via class object in Scala, Convert DF to RDD, TempTable Schema creation and So on.09 2009to04 2015ETL DeveloperAllegis Group Jacksonville,FL,Created and implemented complex business intelligence solutions.Created conceptual, logical and physical data models for use in different business areas.Developed and managed enterprise-wide data analytics environments.Identified, protected and leveraged existing data.Monitored multiple databases to keep track of all company inventory.Assisted maintenance team with completion of preventive maintenance and unscheduled service needs.Monitored installations to ensure compliance with local codes and industry best practices. Education and TrainingExpected intotoMaster of Science Information TechnologyAmity University,Noida, India,GPA Expected in05 2008totoBachelor of Engineering College of Engineering Guindy, Anna University,Chennai, India,GPA  SEP  Build the future of data. Join the Snowflake team. Were hiring talented Software Engineers to join the Snowflake Database team! This position will work directly with our engineering team to evolve our elastic, large scale, high-performance data processing system. We need smart engineers who can pick up and understand complex technical areas quickly and who are enthusiastic about building new technologies! AS A SOFTWARE ENGINEER AT SNOWFLAKE, YOU WILL Design, develop, and support a petabyte-scale cloud database that is highly parallel and fault-tolerant.Build high-quality and highly reliable software to meet the needs of some of the largest companies on the planet.Analyze and understand performance and scalability bottlenecks in the system and solve them.Pinpoint problems, instrument relevant components as needed, and ultimately implement solutions.Design and implement novel query optimization or distributed data processing algorithms which allow Snowflake to provide industry leading data warehousing capabilities.Design and implement the new service architecture required to enable the Snowflake Data CloudDevelop tools for improving our customers insights into their workloads. OUR IDEAL SOFTWARE ENGINEER WILL HAVE 2 years industry experience working on commercial or open-source software.Fluency in Java or C .Familiarity with development in a Linux environment.Excellent problem solving skills, and strong CS fundamentals including data structures, algorithms, and distributed systems.Systems programming skills including multi-threading, concurrency, etc.Experience with implementation testing, debugging and documentation.Bachelors degree or foreign equivalent in Computer Science, Software Engineering or related field Masters or PhD preferred.Ability to work on-site in our San Mateo Bellevue Berlin office. BONUS POINTS FOR EXPERIENCE WITH THE FOLLOWING SQL or other database technologies including internal design and implementation.Query optimization, query execution, compiler design and implementation.Experience with internals of distributed key value stores like FoundationDB and storage engines like RocksDB, InnoDB, BerkeleyDB etc.Experience with MySQL, PostgreSQL internalsData warehouse design, database systems, and large-scale data processing solutions like Hadoop and Spark.Large scale distributed systems, transactions and consistency models.Experience in database replication technologyBig data storage technologies and their applications, e.g., HDFS, Cassandra, Columnar Databases, etc. The following represents the expected range of compensation for this role The estimated base salary range for this role is 150,000 - 218,500.Additionally, this role is eligible to participate in Snowflakes bonus and equity plan. The successful candidates starting salary will be determined based on permissible, non-discriminatory factors such as skills, experience, and geographic location. This role is also eligible for a competitive benefits package that includes medical, dental, vision, life, and disability insurance 401(k) retirement plan flexible spending health savings account at least 12 paid holidays paid time off parental leave employee assistance program and other company benefits. Snowflake is growing fast, and were scaling our team to help enable and accelerate our growth. We are looking for people who share our values, challenge ordinary thinking, and push the pace of innovation while building a future for themselves and Snowflake. How do you want to make your impact?

ATS compatibility: No Fit (score: 21.6)