Bad days, which are more common than you think, I have done it in just under three hours.
Factor in the tolls for the bridges and the jersey turnpike (if you go that way), and it is a major undertaking to drive from NJ to JFK.