Yes you can, it will yield a sweeter filling while the brown gives a bit of a caramelized taste.