I2S: Remove blocking flag check from i2s_disable