Surah Yusuf Tafseer
This query comes natural to mind but Only the prophet Yusuf can answer this question since he was facing the problem. What we guess is that he was looking for an appropriate moment. His brothers could have tried to kill him again with being obliged the way they were, later.