Job description:
the senior manager, data architecture & data engineering is responsible for translating business strategic goals into future-state data engineering and data science solutions. this includes delivery full life-cycle from execution roadmaps, to implementation, and to production operations. this role drives the creation and maintenance of enterprise data and analytics capabilities, data reference architectures, and integrated data & analytics technology roadmaps that will guide our strategic investments and enterprise strategy.translate business strategic goals into actionable future-state data engineering and data science architectures and solutions.delivery of full life-cycle data solutions from execution roadmaps, to implementation, and to operations. this includes a specific focus on elt and etl data pipeline solutions from inception to production.lead end to end solution delivery of enterprise data warehouse, data marts, and data lake with governance.drive the creation and maintenance of enterprise data and analytics capabilities, data solutions, and integrated data & analytics technology roadmaps that will guide our strategic investments and enterprise strategy.deliver architecture connecting data science, data engineering, and data analytics practices together to deliver impactful data products.strong partnership with devops, dataops, business partners, engineering teams, and data management.a minimum of ten (10) years of experience in it with a minimum (6) years in data architecture and data solutions are required.successful track-record in managing a team of data engineers and data scientistsskilled in hybrid cloud data platforms and analytical technologies including azure andor gcp data infrastructure, spark, data lake, data warehouse and data marts, bi reporting with powerbi, metadata management, data governance, master data management, data catalog, and business glossary.ability to document, communicate, implement, and operationalize complex architectures.experience with elt and etl data pipeline solutions from inception to production.proficient in sql, nosql and columnar databases.experience with sparkpyspark and json.excellent grasp of computer science fundamentals - data structures and algorithms.must have panda data frames knowledge and best practices, execution engines, dags (airflow, dagster, luigi, etc), and kubernetes.proficient with gitlabfamiliarity with azure data factory preferred, google data flow or aws glueexperience with biomedical informatics, s3azure blob store, machine learning and ai, unstructured data, and data democratization is preferred.experience with agile methodologies, kanban preferred, and using tools like jira and confluence to facilitate the work.bachelor's degree in computer science or a related discipline required. master's degree preferred. recruiters notes: the role will definitely be hands-on and will require excellent communication skills. the hiring manager mentioned the following technologies: aimachine learning; data warehouses; product support; cloud experienceazure; must be open to new technologies. working with the product development team. act as the point of contact; will create a group that helps the product teams. create data warehouses for analytics. must have excellent communication skills verbal and written. this person will envision strategy and must be able to effectively communicate that strategy to others. the organization has asked me not to advertise the compensation. if you contact me i would be more than willing to share it with you. for over 50 years this non-profit organization has made it their mission to protect patients from unsafe and ineffective medical technologies and practices. more than 5,000 healthcare institutions and systems worldwide including four out of every five u.s. hospitals rely on the services of this organization to guide their operational and strategic decisions. in addition, they serve public and private payers, federal and state agencies, policymakers, ministries of health, associations, and accrediting agencies. benefit from a healthy work-life balance while staying on the leading edge of technology and thriving in an innovative startup-like culture minus the risk. sleep well knowing you are helping achieve a world where safe, high-quality healthcare is accessible to everyone. excellent benefits to include work from home, flex-time and 19 days starting vacation. its a nice place to work!

Resume:
<<summarystrong it experience in aws cloud computing, bigdata & data warehousing.strong business domain knowledge in sales segmentation & territory planning.strong coding & sql experience in python and redshifthaving an experience in agile and deliver the results based on stories and task assigned on the sprint.implementation knowledge in server-less architecture using aws cloud computing.having good hands on experience in git as well as ci/cd pipeline integration.having good hands on experience in building data model based on requirements. skills programming languages: java, python, unix shell scriptingcloud technologies: amazon web services (aws)version control: aws codecommit, git, github repositoriescontinuous integration/continuous delivery(ci/cd): aws codedeploy aws codepipelinedatabases and sql: redshift, oracle, netezza, nosql (ddb & elasticsearch)big data technologies: hadoop, hive, ozzie, airflow, spark, pyspark, scoop, flume experience 01/2018tocurrentsenior data engineersplunk ,collaborated with product owners to gather requirement to help build a solution for sales segmentation.identified key use cases and associated reference architectures for market segments and industry verticals.worked as part of project teams to coordinate database and pipeline development and determine project scopes and limitations.collaborated with solution architects to define database and analytics engagement strategies for operational territories and key accounts.developed and managed enterprise-wide big data environments.specified user access levels for each database segment to protect database integrity and company information.developed and implemented security initiatives to protect important company data.established hardware requirements and devised storage capacity solutions and choose wisely on the aws services by outweigh the requirement and business use-case. 12/2015to 12/2017big data engineernike inc ,perform as a big data developer and work in various phases like data ingestion, data integration and transformation.create a sqoop import command and pull the data (both tables and all tables in db's) from mysql db to hdfs as part of data ingestioncreates a mapreduce programs as well as spark programs to parse, analyze and implement the solutions based on its customer need.perform operations to filter the records from db, boundary query, incremental update or insert in the sqoop import commands.perform operations to insert the data directly to hive tables, change the delimiters and end line character and change the formats like textfile, avrodatafile, orc file into hdfs systems using sqoop import commands.perform sqoop eval function to evaluate the data in mysql.perform sqoop export function to export the data from hdfs and loaded it into mysql and understand the delimiter of the file, define the no of mapper to perform, etc.create a flume config file to ingest the data from various source systems like (spool directory, netcat, exec, sequence, etc.) and loaded it into avro, hdfs etc.define a proper channels(memory, file ,etc.) and loaded all the data comes from source to sinks.used the interceptor to modify the data comes from source like filtering (regex), include the timestamp, search and replace, etc.create a mapreduce program using eclipse ide and execute it through jar file.create a mapper class and using map method generate the key value pair as (node_with_date, system utilization) by writing in context application.create a reducer class and using reduce method, generate the final output of system utilization per node_with_date.implements custom based writable class to get the two values in the mapoutputvalue class.implements custom based partitioner class to assign a appropriate data to the right reducer(basically try to achieve multi-level group by function with mr limitations).implements pattern matching logic for semi-structured data and routed the good and bad records separately.create a custom based input format as well as record reader to parse the xml file.hands-on in creating the broadcast variables.hands-on in sparksql, via class object in scala, convert df to rdd, temptable schema creation and so on. 09/2009to 04/2015etl developerallegis group ,created and implemented complex business intelligence solutions.created conceptual, logical and physical data models for use in different business areas.developed and managed enterprise-wide data analytics environments.identified, protected and leveraged existing data.monitored multiple databases to keep track of all company inventory.assisted maintenance team with completion of preventive maintenance and unscheduled service needs.monitored installations to ensure compliance with local codes and industry best practices. education and trainingexpected intotomaster of science information technologyamity university,noida, india,gpa:expected in 05/2008totobachelor of engineering college of engineering guindy, anna university,chennai, india,gpa:.