SERVER-8992 Better error for invalid polygon

Signed-off-by: Matt Kangas <matt.kangas@10gen.com>