Yes, it is possible to make garlic butter carrots without butter. You can substitute olive oil or another cooking oil for the butter, but the flavor will differ from the original recipe.