Manager Machine Learning at Upstart

The Team
Upstart’s Machine Learning team has a direct impact on our company's success. The team consists of research scientists, data scientists, and machine learning engineers who build and enable our core production models. The fundamental goal of the Machine Learning team is to explore new models and new data sets that can improve the accuracy of our models. With this goal comes near-limitless challenges to tackle, and that is one of the reasons why Upstart is such a unique opportunity. 
The macro, metrics, and monitoring team, a part of Upstart machine learning’s personal loan underwriting team, is focused on monitoring and improving the performance of our underwriting models, particularly with respect to portfolio- and macro-level, rather than loan-level, performance.  The team researches improvements to underwriting, including time-series portfolio-level predictions, adjustments to machine learning underwriting models to improve.  The team also builds portfolio management models, researchers model performance metrics, and builds dashboards and reports on underwriting model performance.
As a Manager of Machine Learning, you will lead the macro, metrics, and monitoring team, managing data scientists and research scientists.  We are also open to hiring an analytics-focused manager for the data scientists on the team.  The manager will be directly responsible for ensuring Upstart’s personal loan underwriting models are originating loans that will achieve our lending partner’s target rates of return.
Position location: This position is available in the following locations: San Mateo, California; Columbus, Ohio; Austin, TX; or Remote USA
Time zone requirements: The team operates on the East/West coast time zones.
Travel requirements: This team has regular onsite collaboration sessions. These occur X days per Quarter at the San Mateo or Columbus offices. If you need to travel to make these meetups, Upstart will cover all travel related expenses.
How you’ll make an impact:

Lead small team of data scientist in building next-generation ML model monitoring framework
Apply knowledge of ML models to model risk monitoring to evaluate the impact of our models on our business and customers  
Building dashboards to identify and remediate anomalies of model behavior in production 
Improving and implementing automated model monitoring capabilities 
Building automated model reporting and drift detection capabilities 
Designing metrics and reports
Stay up-to-date with the latest developments in machine learning, risk monitoring, and artificial intelligence, and incorporate new techniques and best practices into our model monitoring processes.

Minimum qualifications:

Bachelor’s degree in quantitative area of study
1+ years as a data science or machine learning people manager or tech lead 
Understanding of machine learning models and statistical methods
Coding proficiency, preferably in Python
Excellent quantitative critical thinking skills

Preferred qualifications:

Advanced degree in quantitative area of study such as statistics, operations research, finance, mathematics, or related field
Prior experience with dashboarding and ETLs is a plus
Consumer lending knowledge and/or experience within an ML-centric technology company is a plus

What you'll love: 

Competitive Compensation (base + bonus & equity)
Comprehensive medical, dental, and vision coverage with Health Savings Account contributions from Upstart 
401(k) with 100% company match up to $4,500 and immediate vesting and after-tax savings
Employee Stock Purchase Plan (ESPP)
Life and disability insurance
Generous holiday, vacation, sick and safety leave  
Supportive parental, family care, and military leave programs
Annual wellness, technology & ergonomic reimbursement programs
Social activities including team events and onsites, all-company updates, employee resource groups (ERGs), and other interest groups such as book clubs, fitness, investing, and volunteering
Catered lunches + snacks & drinks when working in offices

#LI-REMOTE
#LI-MidSenior