Oh IContainer had the wrong seek flag set. Now will always seek to keyframe it seems. yay!