You can use almond meal (which includes the brown almond skins) in this recipe, but it won't have the exact same buttery texture.