For the given job description <<Allergan Data Labs is on a mission to transform the Allergan Aesthetics beauty business at AbbVie, one of the largest pharmaceutical companies in the world. Our iconic brands include BOTOX Cosmetic, CoolSculpting, JUVDERM and more.

Allergan Data Labs is on a mission to transform the Allergan Aesthetics beauty business at Abbvie, one of the largest pharmaceutical companies in the world. Allergan Aesthetics brands include Botox, CoolSculpting, Juvderm and many more. The medical aesthetics business is ripe for disruption and we're building a high performing Data Science and Engineering team to do just that.

Our team has successfully launched a new and innovative technology platform, All, which serves millions of consumers, tens of thousands of aesthetics providers, and thousands of colleagues throughout the US. Since its launch in November 2020, All has delivered curated promotions, personalized experiences, and millions of consumers use it as part of their beauty journey.

We're looking for a Senior Data Engineer interested in working within a startup-oriented environment while having the backing of a very large company. If that's you, please read on.

You Will
Work with cross functional partners - Data Scientists, Engineers, Product Managers to understand and deliver data needs.Champion code quality, reusability, scalability, security and help make strategic architecture decisions with the lead engineerDesign, build and launch extremely efficient and reliable data pipelines to move data across a number of platforms including Data Warehouse, online caches and real-time systems.Build product-focused datasets and scalable, fault-tolerant pipelines.Build data quality checks, data anomaly detection, and optimize pipelines for ideal compute and storage.Develop APIs and Microservices to expose and integrate data products with software systems
Required Experience & Skills
5+ years of experience as a Data Engineer writing code to extract, ingest, process and store data within SQL, NoSQL and MPP databases like SnowflakeStrong development experience with Python (or ScalaJava)Experience with complex SQL, batch and streaming pipelines with Apache Spark framework.Knowledge of relational and dimensional data modelingExperience with data quality checks, data validation and data anomaly detection.Experience with workflow management engines like AirflowExperience with Git, CICD pipelines, Docker, KubernetesExperience with architecting solutions on AWS or similar public clouds.Experience with Microservices and Event Driven Architecture
Additional Desired Competencies
Experience with offline and online feature engineering solutions for Machine LearningPrevious domain knowledge in the digital marketingExperience with API development to expose data productsExperience with building Data and ML platforminfrastructure
Perks
Competitive salary.Competitive annual bonus targets.401k with dollar-for-dollar match, up to 6% of eligible earnings (base, bonus). Plus, additional company contribution.RSU grants (Long Term Incentives) for approved roles.Comprehensive medical, dental, vision and life insurance.17 paid holidays per year, including 3 floating holidays.Annual Paid Time Off (PTO), with separate sick daysGenerous discounts on SkinMedica skin care products.Discounted aesthetic treatment days multiple times a year.$600 worth of Alle benefits each year to use towards aesthetic treatments and products.Eligible for donation matching to over 1.5 million nonprofit organizations.
Applicable only to applicants applying to a position in any location with pay disclosure requirements under state or local law:
The compensation range described below is the range of possible base pay compensation that the Company believes in good faith it will pay for this role at the time of this posting based on the job grade for this position. Individual compensation paid within this range will depend on many factors including geographic location, and we may ultimately pay more or less than the posted range. This range may be modified in the future.We offer a comprehensive package of benefits including paid time off. (vacation, holidays, sick), medicaldentalvision insurance and 401(k) to eligible employees.This job is eligible to participate in our short-term incentive programs.This job is eligible to participate in our long-term incentive programs.
Note: No amount of pay is considered to be wages or compensation until such amount is earned, vested and determinable. The amount and availability of any bonus, commission, incentive, benefits, or any other form of compensation and benefits that are allocable to a particular employee remains in the Company's sole and absolute discretion unless and until paid and may be modified at the Company's sole and absolute discretion, consistent with applicable law.

Compensation Range (Minimum - Maximum)

$109,500$208,000 USD

Core Values
Be Humble: You're smart yet always interested in learning from others.Work Transparently: You always deal in an honest, direct and transparent way.Take Ownership: You embrace responsibility and find joy in having the answers.Learn More: Through blog posts, newsletters, podcasts, video tutorials and meetups you regularly self educate and improve your skill set.Show Gratitude: You show appreciation and return kindness to those you work with.
Perks For Our Full Time Employees
Competitive salary.Competitive annual bonus targets.401k with dollar for dollar match, up to 6% of eligible earnings (base, bonus). Plus additional company contribution.RSU grants (Long Term Incentives) for approved roles.Comprehensive medical, dental, vision and life insurance.17 paid holidays per year, including 3 floating holidays.Annual Paid Time Off (PTO), with separate sick days12 weeks paid Parental LeaveCaregiver LeaveAdoption and Surrogacy Assistance PlanFlexible workplace accommodations.We celebrate our wins with opportunities to attend Lakers, Knicks, Anaheim Ducks, Anaheim Angels and NY Rangers games.Opportunities to attend concerts, festivals and other live entertainment events in recognition of delivering great work.Tuition reimbursement.Attend a tech or marketing conference of your choice each year.A MacBook Pro and accompanying hardware to do great work.A modern productivity toolset to get work done: Slack, Miro, Loom, Lucid, Google Docs, Atlassian and more.Generous discounts on SkinMedica skin care products.Discounted aesthetic treatment days multiple times a year.$600 worth of Alle benefits each year to use towards aesthetic treatments and products.Eligible for donation matching to over 1.5 million nonprofit organizations.Attend AWS Re:Invent in person (Las Vegas) or virtually each year (for certain roles)>> the resume: <<Professional SummaryEnergetic Data Engineer in developing robust code for high-volume businesses. Strong decision-maker with 6 years of experience in Data engineering and help firms in designing and executing solutions for complex business problems involving large scale data warehousing, real-time analytics and reporting solutions. Ability to translate business questions and concerns into specific quantitative questions that can be answered with available data using sound methodologies.
SkillsPython 3.x, R, SQLHadoop, Apache SparkHive, Pig, Kafka, Sqoop, OozieTeradata, SnowflakeAmazon S3,EMR,LambdaGit, Jenkins, SplunkMS OfficeMicrosoft Visual C#.NET
EducationThe University Of Texas At DallasRichardson,TXExpected in4 2020––Master of Science:Business Analytics-GPA:
Work HistoryAvanade-Data EngineerBangor,ME,04/2020-CurrentCombining data from multiple source systems (Profile, Systematics, etc..) and multiple platforms (Snowflake, OneLake, Hubs) and computing canonical gold-star metrics “once and for all” to cut operational costs.Develop Spark jobs to transform data and apply business transformation rules to load/process data across enterprise and application specific layers.Experience in building/operating/maintaining fault tolerant and scalable data processing integrations using AWS.Configured S3 buckets with various life cycle policies to archive the infrequently accessed data based on requirement.Good working experience on submitting the Spark jobs which shows the metrics of the data which is used for Data Quality Checking.Working on building efficient data pipelines that transform high volume data into a format used for analytical, fraud prevention and ML use cases.Extensively used Splunk Search Processing Language (SPL) queries, Reports, Alerts and Dashboards.Excellent knowledge of source control management concepts such as Branching, Merging, Labeling/Tagging and Integration, with tool like Git.Performing Data Quality checks like row count, schema validation, Hash key validation for all data movement between applications.Avanade-Data EngineerBurlington,NC,08/2019-04/2020Responsible for designing and developing various analytical solutions for gaining analytical insights into large data sets by ingesting and transforming these datasets in the Big Data environment using technologies like Spark, Sqoop, Oozie, HIVE.Scheduling jobs to automate the process for regular executing jobs worked on using Oozie.Developed Oozie workflow schedulers to run multiple Hive and Pig jobs that run independently with time and data availability.Familiar with data architecture including data ingestion pipeline design, Hadoop information architecture, data modeling and data mining,machine learning and advanced data processing.All the projects which I have worked for are Open Source Projects and has been tracked using JIRA.Parallel copying of files between various clusters using Distcp, Kafka in Hadoop.Ascend Learning-Data Scientist InternMemphis,TN,09/2018-12/2018Acquire, clean, integrate, analyze and interpret disparate datasets using a variety of statistical data analysis and data visualization methodologies, reporting and authoring findings where appropriate.Developed Linear Mixed Effects Models for Boston Ed-fi dataset to estimate the teacher contribution to the student test scores.Random intercept model which utilized a pre-post-test design and included fixed effects for student demographics and a growth model where students were nested by time (random slope and intercept) and teacher was tested.Generated various Clustering models for entire West Virginia department of education and evaluated cluster’s performance.Verizon-Big Data Engineer,,01/2014-07/2017Identify customer's digital analytical needs and engage with customer and principal architects daily, understand the business requirements for big data analytical solutions and break down large scale requirements into detailed system specifications.Moving data to HDFS framework using SQOOP from Teradata, SQL Server.Good working experience on Hadoop tools related to Data warehousing like Hive, Pig and also involved in extracting the data from these tools on to the cluster using Sqoop.Solved performance issues in Hive with understanding of joins, groups, bucketing, partitions and working on them using HiveQL.Deployed programs written in PySpark to run Spark MLlib, for analytics and reduced customers churn rate by 25%.
SkillsPython 3.x, R, SQLHadoop, Apache SparkHive, Pig, Kafka, Sqoop, OozieTeradata, SnowflakeAmazon S3,EMR,LambdaGit, Jenkins, SplunkMS OfficeMicrosoft Visual C#.NET>>. The result is, 

Fit assessment: Good Fit