Think I've figured out the magic equation. Can successfully build
libsodium, and I'm pretty sure I understand the proper combination of
sudo and remote_user to make the rest of it work.