oops, forgot about tracking physical offset in data dropping.
XXX: need to update Index API for this too.
add physical offset to the index_add API.