Fix conformance_test.rb to load libraries properly

Previously the files installed into system is loaded if exists
Merge pull request #112 from twitter/fix_conformance_test_a_bit

Fix conformance_test.rb to load libraries properly