Remove duplicate properties during store migration from 2.1 to 2.2

Signed-off-by: Jakub Wieczorek <jakub@jakub.cc>