Revert "Revert "I2C: OMAP: Fix the crash in i2c remove""

This reverts commit d28ebf13024b7e37e7c165ee122dc634198dae1f.