Yes, they can. The ceiling plate of the lamp connects with the junction box in your ceiling, and gravity will ensure your lamp hangs vertically.