Remove fast flag under primary

Fix AUDIO_OUTPUT_FLAG_FAST denied by client due to mismatching sample rate (44100 vs 48000) logcat spam.