Feedback buffer should only be updated every sample