Britney Spears walked off the set of ``X Factor'' moments ago ... and according to several people in the audience, she was upset after a contestant butchered her song, ``Hold It Against Me.''
Britney Spears walks off 'X Factor'