For the given job description <<Allergan Data Labs is on a mission to transform the Allergan Aesthetics beauty business at AbbVie, one of the largest pharmaceutical companies in the world. Our iconic brands include BOTOX Cosmetic, CoolSculpting, JUVDERM and more.

Allergan Data Labs is on a mission to transform the Allergan Aesthetics beauty business at Abbvie, one of the largest pharmaceutical companies in the world. Allergan Aesthetics brands include Botox, CoolSculpting, Juvderm and many more. The medical aesthetics business is ripe for disruption and we're building a high performing Data Science and Engineering team to do just that.

Our team has successfully launched a new and innovative technology platform, All, which serves millions of consumers, tens of thousands of aesthetics providers, and thousands of colleagues throughout the US. Since its launch in November 2020, All has delivered curated promotions, personalized experiences, and millions of consumers use it as part of their beauty journey.

We're looking for a Senior Data Engineer interested in working within a startup-oriented environment while having the backing of a very large company. If that's you, please read on.

You Will
Work with cross functional partners - Data Scientists, Engineers, Product Managers to understand and deliver data needs.Champion code quality, reusability, scalability, security and help make strategic architecture decisions with the lead engineerDesign, build and launch extremely efficient and reliable data pipelines to move data across a number of platforms including Data Warehouse, online caches and real-time systems.Build product-focused datasets and scalable, fault-tolerant pipelines.Build data quality checks, data anomaly detection, and optimize pipelines for ideal compute and storage.Develop APIs and Microservices to expose and integrate data products with software systems
Required Experience & Skills
5+ years of experience as a Data Engineer writing code to extract, ingest, process and store data within SQL, NoSQL and MPP databases like SnowflakeStrong development experience with Python (or ScalaJava)Experience with complex SQL, batch and streaming pipelines with Apache Spark framework.Knowledge of relational and dimensional data modelingExperience with data quality checks, data validation and data anomaly detection.Experience with workflow management engines like AirflowExperience with Git, CICD pipelines, Docker, KubernetesExperience with architecting solutions on AWS or similar public clouds.Experience with Microservices and Event Driven Architecture
Additional Desired Competencies
Experience with offline and online feature engineering solutions for Machine LearningPrevious domain knowledge in the digital marketingExperience with API development to expose data productsExperience with building Data and ML platforminfrastructure
Perks
Competitive salary.Competitive annual bonus targets.401k with dollar-for-dollar match, up to 6% of eligible earnings (base, bonus). Plus, additional company contribution.RSU grants (Long Term Incentives) for approved roles.Comprehensive medical, dental, vision and life insurance.17 paid holidays per year, including 3 floating holidays.Annual Paid Time Off (PTO), with separate sick daysGenerous discounts on SkinMedica skin care products.Discounted aesthetic treatment days multiple times a year.$600 worth of Alle benefits each year to use towards aesthetic treatments and products.Eligible for donation matching to over 1.5 million nonprofit organizations.
Applicable only to applicants applying to a position in any location with pay disclosure requirements under state or local law:
The compensation range described below is the range of possible base pay compensation that the Company believes in good faith it will pay for this role at the time of this posting based on the job grade for this position. Individual compensation paid within this range will depend on many factors including geographic location, and we may ultimately pay more or less than the posted range. This range may be modified in the future.We offer a comprehensive package of benefits including paid time off. (vacation, holidays, sick), medicaldentalvision insurance and 401(k) to eligible employees.This job is eligible to participate in our short-term incentive programs.This job is eligible to participate in our long-term incentive programs.
Note: No amount of pay is considered to be wages or compensation until such amount is earned, vested and determinable. The amount and availability of any bonus, commission, incentive, benefits, or any other form of compensation and benefits that are allocable to a particular employee remains in the Company's sole and absolute discretion unless and until paid and may be modified at the Company's sole and absolute discretion, consistent with applicable law.

Compensation Range (Minimum - Maximum)

$109,500$208,000 USD

Core Values
Be Humble: You're smart yet always interested in learning from others.Work Transparently: You always deal in an honest, direct and transparent way.Take Ownership: You embrace responsibility and find joy in having the answers.Learn More: Through blog posts, newsletters, podcasts, video tutorials and meetups you regularly self educate and improve your skill set.Show Gratitude: You show appreciation and return kindness to those you work with.
Perks For Our Full Time Employees
Competitive salary.Competitive annual bonus targets.401k with dollar for dollar match, up to 6% of eligible earnings (base, bonus). Plus additional company contribution.RSU grants (Long Term Incentives) for approved roles.Comprehensive medical, dental, vision and life insurance.17 paid holidays per year, including 3 floating holidays.Annual Paid Time Off (PTO), with separate sick days12 weeks paid Parental LeaveCaregiver LeaveAdoption and Surrogacy Assistance PlanFlexible workplace accommodations.We celebrate our wins with opportunities to attend Lakers, Knicks, Anaheim Ducks, Anaheim Angels and NY Rangers games.Opportunities to attend concerts, festivals and other live entertainment events in recognition of delivering great work.Tuition reimbursement.Attend a tech or marketing conference of your choice each year.A MacBook Pro and accompanying hardware to do great work.A modern productivity toolset to get work done: Slack, Miro, Loom, Lucid, Google Docs, Atlassian and more.Generous discounts on SkinMedica skin care products.Discounted aesthetic treatment days multiple times a year.$600 worth of Alle benefits each year to use towards aesthetic treatments and products.Eligible for donation matching to over 1.5 million nonprofit organizations.Attend AWS Re:Invent in person (Las Vegas) or virtually each year (for certain roles)>> the resume: <<EducationBachelor of Engineering:Computer Science & Information Technology,Expected in05/2011toSri Krishnadevaraya University-Kurnool, AndhraPradesh,GPA:
SkillsETL Tools : DataStage ,Informatica Power Centre and SSIS PackagesBig Data Technologies : Hive,Spark , HDFS,Kafka, SqoopDatabase : Oracle ,SQL Server,DB2, Netezza , Mongo, SnowflakeProgramming Languages : UNIX, Python, PL/SQLWorking experience in Agile ,Waterfall model and tracking in JIRRA and Microsoft DevopsConfiguration Tools : PVCS , Microsoft TFS, Azure CI/CD pipelineCloud Experience: AzureJob Scheduling Tools: CA7, Control -MOperating System : Win XP, 7, 10 and UNIX.AdaptabilityData managementOrganization and Time managementTeamwork
Professional SummaryHaving 9 years of Industry experience in ETL Tools such as DataStage , Informatica and SSI Packages.Having experience in Data Bricks, Hive SQL, Azure CI/CD pipeline, Delta Lake, Data Lake, Hadoop File system, SnowflakeHaving experience in Building ETL pipe lines using Apache Spark, PythonExcellent Experience in Designing, Developing, Documenting, Testing of ETL jobs and mappings in Server and Parallel jobs using DataStage/Informatica to populate tables in Data Warehouse, DataMart ,ODS and Large Data sets.Experience in working on streaming data using IBM MQ and Kafka.Experience in working using Agile(SCRUM) and Waterfall Development MethodologyExperience in logging tickets in Service now, Version control tools PVCS, Azure DevOps CI/CD pipelineExperience in Azure work environment.Work experience in IBM Master Data Management(MDM) ArchitectureWorking Experience on Azure CloudExperience in working with multiple Data Bases like Oracle, SQL Server, DB2, Netezza, NOSQL Mongo DB, Salesforce, Snowflake DBExperience in working on data migration from oracle 9i to 10g and DB2 to NetezzaExpertise in using DataStage/Informatica to integrate with different Sources and Targets like Azure SQL database, Oracle, Mainframe systems, Netezza, Salesforce, SOAP and REST services, XML, SQL Server and MongoDBExperience in UNIX, AIX and Linux server resource monitoring and load balancing.Ensured that user requirements are effectively and accurately communicated to the other members of the development team and Facilitate communications between business users, developers and testing teams.Conducting internal and external reviews as well as formal walkthrough among various teams, and documenting the proceedings.Excellent problem-solving and trouble-shooting capabilities. Quick learner, highly motivated, result oriented and an enthusiastic team player
Work HistorySenior Data Engineer,02/2021toCurrentFactset Research Systems Inc.–San Francisco,CA,Bank Operational Data Distribution Hub is highly availability distribution center for operational data. The servers have been set up to provide failover capabilities in the event of any issues which could cause the hardware to shut down. The design of this system focuses on four main vendors. We load data toHDFS storage as well and built HIVE on top of this to analyze.Developed, implemented, supported and maintained data analytics protocols, standards and documentation.Analyzed complex data and identified anomalies, trends and risks to provide useful insights to improve internal controls.Contributed to internal activities for overall process improvements, efficiencies and innovation.Communicated new or updated data requirements to global team.Explained data results clearly and discussed how it can be utilized to support project objectives.Planned and implemented security measures to safeguard vital business data.Created and implemented database designs and data models.Monitored incoming data analytics requests, executed analytics and efficiently distributed results to support strategies.Built databases and table structures following OLAP/OLTP architecture methodology for web applications.Lead Data Engineer,01/2018to01/2021Cox Communications Inc–Dayton,OH,Master Data Management(MDM) EQH is primary vehicle for customer self-service for Life and Annuity products. Displays current policy values, statements, confirmation notices and prospectuses. Supports profile maintenance including address, phone, and email address changes, financial profile and investment strategies. Self-service tools include performance, financial transactions, ACH payments, and loans.Responsibilities:.Leads program/project application engineering teams consisting of cross functional, global, and virtual groups; directly supervises staff; assigns responsibility to members; monitors progress of daily activities.Monitor and manage program/project application engineering baseline to ensure activities are occurring as planned - scope, budget and schedule and managing variances.Managed performance monitoring and tuning while identifying and repairing issues within database realmProactively identify risks, issues and problems on programs/projects - leading engineering and project/program team to develop risk management and issue management plans.I have saved 1 person monitoring work by performing optimizationAbility to clearly articulate problems and proposed options and solutions and apply judgment in implementing application engineering methodologies, processes and practices to ensure security, resilience, maintainability and quality of MDM solutions.Analyses and defines detailed MDM processes, tasks, data flows, and dependencies.Develop custom mapping functions.Participates in system and integration testing.Produces database code (SQL, stored procedures, and any other database specific code) solutions meeting technical specifications and business requirements according to established designs.Proactively resolved issues within team.Validated warehouse data structure and accuracy.Cooperated fully with product owners and enterprise architects to understand requirements.Collaborated with multi-functional roles to communicate and align development efforts.Mapped data between source systems and warehouses.Performed systems and data analysis using variety of computer languages and procedures.Documented data warehouse architecture to guarantee capacity met current and forecasted needs.Developed and modified programs to meet customer requirements.Quickly learned new skills and applied them to daily tasks, improving efficiency and productivity.Provided global thought leadership in analytics solutions to benefit customersSenior ETL Developer,08/2017to12/2017Epam Systems Inc–Washington,DC,Netezza Re-write: This project is about migrating around 70 Data Marts runs on Oracle to Netezza in 10 phases. This includes redesigning DataStage jobs integrates with oracle to change it to Netezza and Informatica to DataStage migration.Role & Responsibilities :Requirement Analysis, Creating mappings, Unit Testing, Defect Fixing, Documentation and Status Reporting.Identifying Entities, cardinality and developing Logical and Physical Data Model.Mentored newly hired employees, offering insight into job duties and company policies for easier transition to job positionPrioritized and organized tasks to efficiently accomplish service goalsAnalyzing existing process, scripts and preparing design document with performance optimized approach.Performed impact analysis on every source and target tables.Responsible for estimation of Design, Development and Unit testing.Analyzing dependent objects and data involved and updating efficient unit testing approach.Responsible for scheduling changes which includes changing node to new 11.5 server, change in run time parameters, change in predecessor or successor requirements and removing jobs.Have published Play book or Implementation plan for every release.Responsible for driving, implementation and doing post implementation data checks.Resolved complex DataStage performance issues and other environment issues.Designed and Developed reusable components which can parse dsx and provide input and output SQLs used in DataStage code.Reviewed Netezza Deliverables and DataStage deliverables in every phase of project.Resolved Netezza SQL issues to Business users.Co-ordinated with downstream systems and worked on impacted system sign off, review and production preparation.Senior ETL Developer,01/2016to07/2017Epam Systems Inc–PA,State,Financial Move Forward (inforce Data): Equitable Enterprise Data Warehouse (EDW) manages collection of components in both Mainframe (Information Database(IDB)) and Distributed environments (Open system Data Warehouse(OSDW)) that include batch processes, operational data stores, business intelligence (BI) data marts and general data services to all IT lines of business.FMF-Inforce Data project consists of two phases.First phase involves migration of DB2 data to Netezza DB with help of integrated ETL tool [Data Stage 8.7].Second phase contains Data Modelling and DataMart design of migrated tables in Netezza.First phase, basically involves initial data load (IDL) of 400 Db2 tables to Netezza DB.Took care of installing Netezza client on UNIX box where Data stage client exists and ensured connectivity is good for designing data stage jobs Role & Responsibilities:.Understanding requirements and coming up with high level design.Created Low-level design of mapping document.Created mappings and transformations as per business requirements.Writing re-usable mapplets and Oracle PL/SQL stored procedures.Unit test jobs according to test plans.Monitored, debugged, and scheduled mappings according to requirements.Improving performance of mapping execution thus reducing CPU and execution cost and time.Providing System Testing and User Testing Support IQA of Mappings.Capable of assisting team of developers, both onshore and offshore to provide strategic plan for execution of this project.Ability to work with key team members to ensure solution meets business requirements.Provided Proof of Concept (POC) for technical approach regarding design of data stage jobs.Understanding requirements and coming up with technical design strategies with project team and business users.Contributed to detailed estimation of development work.Involved in Estimation of DBA Effort for this project.Designed Field level mapping template design based on business rules/ transformations and validations.Performed problem assessment, resolution and documentation for new and existing database objects.Prepared Knowledge Transition documents which were appreciated by business IT people.Communicated with data architects, programmers and engineers to keep projects on track.>>. The result is, 

Fit assessment: Good Fit