For the given job description <<Allergan Data Labs is on a mission to transform the Allergan Aesthetics beauty business at AbbVie, one of the largest pharmaceutical companies in the world. Our iconic brands include BOTOX Cosmetic, CoolSculpting, JUVDERM and more.

Allergan Data Labs is on a mission to transform the Allergan Aesthetics beauty business at Abbvie, one of the largest pharmaceutical companies in the world. Allergan Aesthetics brands include Botox, CoolSculpting, Juvderm and many more. The medical aesthetics business is ripe for disruption and we're building a high performing Data Science and Engineering team to do just that.

Our team has successfully launched a new and innovative technology platform, All, which serves millions of consumers, tens of thousands of aesthetics providers, and thousands of colleagues throughout the US. Since its launch in November 2020, All has delivered curated promotions, personalized experiences, and millions of consumers use it as part of their beauty journey.

We're looking for a Senior Data Engineer interested in working within a startup-oriented environment while having the backing of a very large company. If that's you, please read on.

You Will
Work with cross functional partners - Data Scientists, Engineers, Product Managers to understand and deliver data needs.Champion code quality, reusability, scalability, security and help make strategic architecture decisions with the lead engineerDesign, build and launch extremely efficient and reliable data pipelines to move data across a number of platforms including Data Warehouse, online caches and real-time systems.Build product-focused datasets and scalable, fault-tolerant pipelines.Build data quality checks, data anomaly detection, and optimize pipelines for ideal compute and storage.Develop APIs and Microservices to expose and integrate data products with software systems
Required Experience & Skills
5+ years of experience as a Data Engineer writing code to extract, ingest, process and store data within SQL, NoSQL and MPP databases like SnowflakeStrong development experience with Python (or ScalaJava)Experience with complex SQL, batch and streaming pipelines with Apache Spark framework.Knowledge of relational and dimensional data modelingExperience with data quality checks, data validation and data anomaly detection.Experience with workflow management engines like AirflowExperience with Git, CICD pipelines, Docker, KubernetesExperience with architecting solutions on AWS or similar public clouds.Experience with Microservices and Event Driven Architecture
Additional Desired Competencies
Experience with offline and online feature engineering solutions for Machine LearningPrevious domain knowledge in the digital marketingExperience with API development to expose data productsExperience with building Data and ML platforminfrastructure
Perks
Competitive salary.Competitive annual bonus targets.401k with dollar-for-dollar match, up to 6% of eligible earnings (base, bonus). Plus, additional company contribution.RSU grants (Long Term Incentives) for approved roles.Comprehensive medical, dental, vision and life insurance.17 paid holidays per year, including 3 floating holidays.Annual Paid Time Off (PTO), with separate sick daysGenerous discounts on SkinMedica skin care products.Discounted aesthetic treatment days multiple times a year.$600 worth of Alle benefits each year to use towards aesthetic treatments and products.Eligible for donation matching to over 1.5 million nonprofit organizations.
Applicable only to applicants applying to a position in any location with pay disclosure requirements under state or local law:
The compensation range described below is the range of possible base pay compensation that the Company believes in good faith it will pay for this role at the time of this posting based on the job grade for this position. Individual compensation paid within this range will depend on many factors including geographic location, and we may ultimately pay more or less than the posted range. This range may be modified in the future.We offer a comprehensive package of benefits including paid time off. (vacation, holidays, sick), medicaldentalvision insurance and 401(k) to eligible employees.This job is eligible to participate in our short-term incentive programs.This job is eligible to participate in our long-term incentive programs.
Note: No amount of pay is considered to be wages or compensation until such amount is earned, vested and determinable. The amount and availability of any bonus, commission, incentive, benefits, or any other form of compensation and benefits that are allocable to a particular employee remains in the Company's sole and absolute discretion unless and until paid and may be modified at the Company's sole and absolute discretion, consistent with applicable law.

Compensation Range (Minimum - Maximum)

$109,500$208,000 USD

Core Values
Be Humble: You're smart yet always interested in learning from others.Work Transparently: You always deal in an honest, direct and transparent way.Take Ownership: You embrace responsibility and find joy in having the answers.Learn More: Through blog posts, newsletters, podcasts, video tutorials and meetups you regularly self educate and improve your skill set.Show Gratitude: You show appreciation and return kindness to those you work with.
Perks For Our Full Time Employees
Competitive salary.Competitive annual bonus targets.401k with dollar for dollar match, up to 6% of eligible earnings (base, bonus). Plus additional company contribution.RSU grants (Long Term Incentives) for approved roles.Comprehensive medical, dental, vision and life insurance.17 paid holidays per year, including 3 floating holidays.Annual Paid Time Off (PTO), with separate sick days12 weeks paid Parental LeaveCaregiver LeaveAdoption and Surrogacy Assistance PlanFlexible workplace accommodations.We celebrate our wins with opportunities to attend Lakers, Knicks, Anaheim Ducks, Anaheim Angels and NY Rangers games.Opportunities to attend concerts, festivals and other live entertainment events in recognition of delivering great work.Tuition reimbursement.Attend a tech or marketing conference of your choice each year.A MacBook Pro and accompanying hardware to do great work.A modern productivity toolset to get work done: Slack, Miro, Loom, Lucid, Google Docs, Atlassian and more.Generous discounts on SkinMedica skin care products.Discounted aesthetic treatment days multiple times a year.$600 worth of Alle benefits each year to use towards aesthetic treatments and products.Eligible for donation matching to over 1.5 million nonprofit organizations.Attend AWS Re:Invent in person (Las Vegas) or virtually each year (for certain roles)>> the resume: <<SummaryData Engineeringwith experience in Design, Development, Implementation and support ofData Warehousingfor over8 years. Experienced in completeSoftware Development Life Cycle (SDLC),software Testing Life Cycle (STLC),SDLC methodologies. Extensively worked onInformatica Designer Tools(Source Analyze, Warehouse Designer, Mapping Designer, Mapplet Designer, and Transformation Developer) and Workflow Manager Tools (Task Developer, Worklet and Workflow Designer), Workflow Monitor and informatica Power exchange. Experience in working with using Informatica inSAP HANA,Oracle,MS SQL,TeradataandDB2 environments. Hands on experience in migrating on premise ETL toGoogle Cloud Platform(GCP)using cloud native tools such asBIG Query,Cloud Data Proc,Google Cloud Storage,Composer.Practical understanding of the Data modeling concepts likeStar - Schema Modeling, snowflake Schema Modeling, Fact and Dimension tables. Also experience in Optimizing Database querying, data manipulation using SQL andPL/SQLin Oracle, flat files and SQL server database. Experienced in implementingChange Data Capture (CDC)using informatica Power Center for Oracle and SAP Systems. Experienced in debugging mapping by analyzing the data flow and evaluating transformations. Experienced in performance tuning of data flow through source, target, sessions and mappings,identifying and resolving performance bottlenecks at various stagesusing techniques like Database tuning and Session Partitioning. Experienced in test strategy, developing test plan, details test cases, and writing test scripts by decomposing business requirements, and developing test scenarios to support quality deliverables. Involved in test planning and execution for various Test Phases:Unit Test,System and User Acceptance Testing. Expert inanalyzing, designing, developing, installing, configuringanddeployingMS SQL Server suite of products with Business Intelligence in SQL Server Reporting Services, SQL Server Analysis Services and SQL Server Integration Services. Performed data profiling, data cleansing, data conversion, exception handling and data matching usinginformatica IDQ.Excellent communication skills, good organizational skills, self-motivated, hardworking, ability to grasp quickly and learn fast and open to new technologies.
Skills & ToolsETL Tools Informatica Power Center 10.5.1 Power Exchange 9.6.1/9.0.1, Informatica Data Quality 9.6.1, Power connect for SAP BW, power connect for JMS, power connect for IBM MQ series, power connect for Mainframes, DTS, MDM, ERWIN.Scheduling, TIDAL, UC4, CONTROL-M, AUTOSYS, OpCon.Oracle, SAP HANA, MS SQL Server, Snowflake, MongoDB, Teradata, DB2, AWS.Python, Java, SQL, UNIX, Unix Shell Scripts, HTML, XML, JSON, Microsoft Office, Apache Spark, Kafka, Kubernetes, Hive, ScalaData analysis, Data management, Data warehouse, Big Data, PL/SQL, RDBMS, NoSQL, Vertica, Spark, Kafka, Oozie, Maven.Debugging, Coding, Designing, Quality analysis, ETL, SAP BW.AWS Cloud Tools: EC2, Elastic Load-balancers, Elastic Container Service (Docker Containers), S3, Elastic Beanstalk, Cloud Front, Elastic Files System, RDS, Dynamo DB, DMS, VPC, Direct Connect, Route53, Cloud Watch, Cloud Trail, Cloud Formation, IAM, EMR, ELB, Lambda functions, REST API, Airflow, Data Pipeline, RedShift.Google Cloud Platform: GCP Cloud Storage, Big Query, Composer, Cloud Dataproc, Cloud SQL, Cloud Functions, Cloud Pub/Sub, Dataflow, AI Building Blocks, Looker, Cloud Data Fusion, Dataprep, Firestone.Azure: Azure Storage, Database, Azure Data Factory, Azure Analysis Services.
Education and TrainingNew England CollegeHenniker,NHExpected in12/2017––Master of Science:Computer And Information Systems-GPA:
ExperienceLockheed Martin-Data EngineerEagan,MN,08/2019-CurrentResponsible in Identifying all the Legacy systems, analyze theirdata models, mathematical and.Scientific models and all the business components to be migrated to Arkansas Integrated Eligibility system (ARIES)NexGen solution.Business and Data Mapping Analyst worked with Client to gather business and functional requirements.Experience in building large-scale data pipelines and data-centric applications using Big Data tooling like Hadoop, Spark, Hive and Airflow in a production setting.Experience in working with Rest APIs for data extraction.Designing and coordinating withInformatica Power centeradmin to set up services, users, Groups, database components like tables, indexes, procedures and synonyms, Unix groups and User access for ARIES system.Designing all the components of ARIES system and step by step conversion approach using theRalph KimballandBill Inmomdata warehouse design methodologies to determine the feasibility of the design within the time and cost constraints.Development ofETL(Extract, Transform and Load) code components like mappings, Workflows, Sessions and database objects like stored procedures, functions andUnix shell scriptsfrom business requirements and design plan.Designing and developing the mathematical models and analytical reports inCognos, analyze.Developing integrations usingInformatica CloudData Integration(IICS–CDIService) For Google Analytics.Responsible Identifying the performance bottleneck in the ARIES systems during Integrated,Testing(IT) andSystem Testing(ST) and PT (Performance Testing) phases and implement Performance tuning techniques.Confer with the scrum master, client partners, Business Managers and adhere to theagile.Experience in multiple database technologies such as traditional RDBMS (MS SQL Server, Oracle, MySQL, PostgreSQL), MPP (AWS Redshift, Snowflake, Teradata), Distributed Processing (Spark, Hadoop, EMR), NoSQL (MongoDB, DynamoDB, Cassandra, Neo4J, Titan).Conduct code review sessions with peer developers to ensure code quality.Wrote scripts and processes fordata integrationand bug fixes.UtilizedPythonto handle debugging and automation scripting tasks.Created and implemented complex business intelligence solutions.Create & Managing buckets onS3and store DB and log backup, upload images for CND server.Setup databases onAmazon RDSorEC2 Instancesas per requirements.Hands-on experience with snowflake utilities, SnowSQL, SnowPipe, Big data model techniques using python.Expert in migrating data from various systems into Salesforce CRM using ETL tools -Informatica.Hands on Experience inData Management, Data Security, Data Modeling, Data Quality, Workflow Automation, Formulas & Validations.Collaborated with Legacy team to define data extraction methodologies and data source tracking protocols.UsedSpark-SQL to read parquet data and create tables inHiveusingScala API.Hands on experience with data ingestion tools likeSqoop, Kafka, Flume.Used variousspark transformationsandActionsfor cleansing the input data.Installed and configuredApace Airflowfor workflow management and created workflow in python.Worked on Tableau Desktop versions 7/8.2, Tableau Reader and Server.Build data pipelines in Airflow in GCP for ETL related jobs using different airflow operators.Experience in GCP Dataproc, GCS, Cloud functions, BigQuery.Wells Fargo-BI_ETL DeveloperLoveland,CO,11/2018-07/2019Analyzing the source data coming from Mainframe sources and working with business users and developers to develop the Model.Created xsd and used it inxml generator Transformation.Also calledWSDLfiles using web consumer transformation inInformatica.Effectively and efficiently communicated systems solutions to business problems to team members, business unit representatives, management, and other impacted project teams.Analyze and modify existing stored procedures, functions, and queries in order to integrate them into previously built reporting application utilizingSSISandSQL Server Management Studio.Change ETL process fromimporting flat filesandCOBOLas source for previously built application utilizing informatica Power center 9.6 to read data from existing Reporting Server (SQL Server databases).Interface with report users to determine requirements for new and existing reports.Develop, test, and deployETLjobs with reliable error/exception handling and rollback framework Manage automation of file processing as well as all ETL processes within a jobworkflow.Worked as a Data Analysts to match the current data mappings with old mainframe mappings.Created Design Documents, Context Diagrams on every Projects and did code review.Created Reusable lookup to send emails Notification to User's.This Lookup was used by multiple developer in multiple Projects.STOP and START theNetezzaappliances in case of issues.Prepared best practices documentation for teams in writingNOSQL.Conducted sessions to help explain teams about theNetezzaarchitecture and design.As a part of Informatica decommission objects Project UsedSVNto archive the ETL Code and delete the unwanted mappings and workflows.Extracted data fromflat fileand staged into a single place and applied business logic to load them in theTeradata database.Lead in few complex Projects and Performed Unit testing and createdQA documents.Participated in solution brainstorming and provided technical instruction and coaching to others within organization.Developed technical project deliverables.Created spreadsheets usingPower BIandPower Pivotby importing data from the sources directly.Created visually impactful dashboards in Excel andTableaufor data reporting usingPivotTablesandVLOOKUP.Involved in migrating ETL code lower environments to like dev/ test/Load to production environment.UsedDebuggerfor debugging Mappings.CreatedTidalJobs andRunbooksto schedule jobs in Tidal.Scheduling ETL Jobs usingUC4 scheduler.Migrated ETL code using Deployment Groups from Dev to Prod environments.Created SSIS package for loading the data coming from various interfaces like OMS, Orders, Adjustments and Objectives and also used multiple transformation in SSIS to collect data from various sources.Worked on SSIS Package, DTS Import/Export for transferring data from Database (Oracle and Text format data) to SQL Server.CreatedSSISpackages for File Transfer from one location to the other using FTP task.Manage and document our platform infrastructure. This can go from installing a new Consul server to resolving performance issues in a MongoDB cluster, through setting up a continuous integration pipeline.Cognizant Technology Solutions-Informatica DeveloperHorsham,PA,12/2017-10/2018Involved in all the phases of the development like Analysis, Design, Coding,Unit Testing, System Testing and UAT.Extracted data fromheterogenous sourcesand performed complex transformations to load data into the target systems.Resolved various performance issues by examining the logs, current design andremoving the bottlenecks.Created reusable ETL components which need to be run at the mapping, session and workflow levels.Wrote complex SQL queries and performed extensive data analysis inOracle 11g.Peer reviewed developers code and ensured they fall into the enterprise guidelines.Worked extensively with session parameters, Mapping Parameters, Mapping Variables and Parameter files for Incremental Loading.Created Informatica mappings to load Payment flow, BT cash data, Currency conversion data fromSAP HANA DSL layertoSAP HANA DPL layer/DLL (SAP BA layer),Implemented SAP BW andBOBJwith different SAP data source.UsedQlikand Informatica forETL& reporting.Worked closely withSAP ABAPteam to create logical systems, RFC destinations and to create tRFC port for RFC destinations.Followed best practices that were defined at the enterprise level and also peer reviewed the code for the same.Created and reviewed scripts to create new tables, queries for new enhancements and bug fixes in the existingdata warehouse.Used Debugger and various other techniques like tracing to fix the defects/ errors and data issues.Extensively worked with various Lookup caches likeStatic cache, Dynamic cache and Persistent cache.Involved in developing the Deployment groups for deploying the code between various environment (Dev, QA).Worked in the Data Integration Team to perform data and application integration with a goal of moving more data more effectively, efficiently and with high performance to assist in business-critical projects coming up with huge data extraction.Migrated data from SQL Server toNetezza using NZ_Migrate utility.Experience in integration of various data sources likeOracle, DB2, SQL server, .csv, XML and Flat Filesinto staging area.Developed code to extract, transform, and load (ETL) data from inbound flat files and various databases into outboundflat filesandXMLfiles using complex business logic.Involved in deploying objects from DEV to UAT/PROD during monthly/quarterly releases.Developed Slowly Changing Dimension Mappings forType 1SCDandType 2 SCDMonitored and improved query performance by creating views, indexes and sub queries Extensively involved in enhancing and managing Unix Shell Scripts.Developed workflow dependency inInformaticausing Event Wait Task, Command Wait.Involved inL3 Supportby fixing load failures and defects during peak and off-Peak hours.Working with Informatica andSAP ECC.We are extracting data in Informatica fromSAP ECCvia.Business Content Data sources.Design the ETL architecture for the conversion of source from legacy to newERP (SAP).Built Sqoop scripts to extract data from the SAP.Responsible for data integration (Epicor and SAP) and data management.Validated DW data with standardSAP reports.ObjectOne Information Systems-ETL Informatica DeveloperCity,STATE,08/2013-12/2015· Responsible for developing ETL mappings for the reporting requirement & for data feeds.· Created mapplets and many other reusable components reduce redundancy.· Provided the best solution for their requirement. Help the Clients in designing of the system and process to make it more robust and meaningful.· Created the ETL component and test scripts. Involved in client meetings for their inconsistent requirements.· Sourced data fromSAP HANAusingSAP Adapterin Informatica Target Tables.· End to end processing from the source to target. Load the data from various File systems to theDWHandDM. Maintain the Versioning for the objects by usingVSS.· Successfully conducted Load Testing and Performance Testing.· Resolve the issues coming from the end to end processing. Perform the enhancements if required by the business users. requirement & for data feeds· Involved in preparing Source to Target mappings and Application Design Document. Worked closely with all upstream and downstream application owners to make sure interface agreement documents are clear.· Successfully conducted Load Testing and Performance Testing. Automated regression test suite for actuate reporting and true portal.· UsedALMto track and report system defects and bugs, writing modification request for the bugs in the application and helped developers to track the problem and resolve the technical issues.>>. The result is, 

Fit assessment: Good Fit