Fail more gracefully when layers can't be added