Add libyaml
Clean up dependencies more
Fix incorrect library directory structure