@tknerr metadata deps not honored

Originally #712, but updated to conform to our test structure. Merge this instead of #712, but let's keep the conversation there. (I think merging this will automatically close #712). 

Since this is a branch on RiotGames/berkshelf, anyone on the team can push and make changes.