Yes, the batter needs to be deep fried for the nuggets to turn out correctly.  Cooking the tempura batter in very hot oil for frying helps to create a light crispy fried chicken. Crispy tempura chicken cannot happen in an oven or air fryer.