I confess I'm not crazy about the Builder pattern either. I like it conceptually but all the extra code makes me cry.

However, Effective Java sez, "If you start out with constructors or static factories, and add a builder when the class evolves to the point where the number of parameters starts to get out of hand, the obsolete constructors or static factories will stick out like a sore thumb. Therefore, it’s often better to start with a builder in the first place."

Even more important than that is the consistency. The line immediately below it uses Builder. It's weird for a developer to have to use new for one object and Builder for another.

Anyway...that's my rationale. Please use a Builder.