What about remove the add poll button?

I always hated that (those) button(s)...

The elements of the form are ajax-ively loaded at their normal place. If ajax is missing it does a bad trick submitting the form. It generates an error (no question and not enough answers), but it works and anyway add polls without javascript is a p.i.t.a..