No, because this phrase refers to a person's feelings about taking on risk, you would use risk-averse, not adverse.