Yes, you can make Margarita Cupcakes without tequila by simply omitting it from the recipe. However, it's the tequila that gives the cupcakes their unique flavor, making it taste like a margarita. Simply use milk in place of the tequila in the frosting, and don't brush the cupcakes with tequila.