Revert "Add patch to delay non-seat0 display servers startup"

This reverts commit 4bf7944a13f4986048df206c9b66a3cde5aa96ff.