The penalty for building without a permit in New Jersey may involve fines, stop-work orders, and potential legal actions, including injunctions or orders to remove or rectify the unauthorized construction. The specific penalties can vary depending on the nature and extent of the violations.