Improve All Apps --> Workspace performance

Fix bug where HW layers were not enabled for that
transition

Bug: 8323765

Change-Id: Ifae4a17148ae0091b5f592e5150054b0c1269fb1