Fix cache updating in AbstractRemoteDataSource on row remove (#13334)

Also contains a minor performance tweak for row adding in start of the
cache and updates to cell focus logic.

Change-Id: Ia64e43dd5ae8777014885b5e7dd05cb31b54eae2