Revert "Delay UL powerdown if BAM is in polling mode"

This reverts commit b912e97bf64a02c46eb790dabfe0feca06dd392c.