Clue: Always having to turn in, the moment causing irritation for the poet (7)
Answer: NOYANCE
Explanation: Definition: irritation for the poet 
**<=AY** [*having to turn*] *in* **NONCE** ("the moment") 
Noyance i*s a poetic version of annoyance.