Clue: Clergyman most sorry to lose key (6)
Answer: PRIEST
Explanation: Definition: Clergyman
P[alt]RIEST ('most sorry') minus ALT ('to lose key'). The answer was obvious, but it took me a ling time to come up with the right key, even though it is staring me in the face!