Pressing buttons 1-4 on your numpad will build. Holding enter on your numpad and then pressing 1-4 will destroy.