empty frames should be all -1 so merging works