Fix issue related to exponential increase

During optimization, introduced bug.

Signed-off-by: Srinivas Pandruvada <srinivas.pandruvada@linux.intel.com>