Respect specified_queues when looking at scheduled and retry works

Before this commit, scheduled and retry works was searched in every queues.

PS: Thanks for using Guard!