If there are any explicit authorized_keys passed in for an app, add them
to the newly created user