split out the tests
ignore $type field in json if it's not compatible with the hint