Version Constraint in metadata.rb not honored

Originally #709, but this includes a failing cucumber scenario for the feature. 

**This will need back-ported into 2-0-stable**