Yes, it's illegal. Don't be fooled by all the fireworks stands off I-95; it's a misdemeanor and you risk a $500 fine if you do it.