kmselement: Avoid deadlock not setting pad to inactive before removing it

Change-Id: I44db1e9219dbb205974bf0a96c24b87ee2c44eaf
compositemixer: Remove agnostics from compositemixer

Change-Id: Ic26301f17c40ce49623192f7b4ff7779ce021bec
compositemixer: Fix race condition recalculating sizes

Change-Id: I48ffc41ce82bbf3bf3ad4f46fa66528476e9a49d