Minimal input propagation

- Add new input before removing old input
- Don't clear all inputs, just those that were set last time