h264: disallow single unpaired fields as references of frames

Fixes deadlock