An apparatus for controlling a motion-based user interface, the apparatus comprising: a touch screen configured to display an image and receive input of a user touch on at least one spot; a sensor unit configured to sense a motion of the apparatus; and a controller configured to: when the at least one spot is touched on the touch screen, determine a number of touched spots; and obtain information corresponding to the movement of the apparatus, wherein the controller is further configured to determine whether the number of touched spots is two or more, whether the touched spots move, and whether the movement of the apparatus is sensed, wherein if the number of touched spots is two or more, the touched spots do not move, and the movement of the apparatus is sensed, the controller is further configured to: display an image on the touch screen by zooming out the image based on a determination that the information indicates that the apparatus moves away from the user; or display the image on the touch screen by zooming in the image based on a determination that the information indicates that the apparatus moves toward the user, and wherein if the number of touched spots is two or more and the touched spots move, the controller is further configured to deactivate the motion based zoom in and zoom out function, and display an image on the touch screen by zooming in or zooming out the image based on the motion of the touched spots. a touch screen configured to display an image and receive input of a user touch on at least one spot; a sensor unit configured to sense a motion of the apparatus; and a controller configured to: when the at least one spot is touched on the touch screen, determine a number of touched spots; and obtain information corresponding to the movement of the apparatus, when the at least one spot is touched on the touch screen, determine a number of touched spots; and obtain information corresponding to the movement of the apparatus, wherein the controller is further configured to determine whether the number of touched spots is two or more, whether the touched spots move, and whether the movement of the apparatus is sensed, wherein if the number of touched spots is two or more, the touched spots do not move, and the movement of the apparatus is sensed, the controller is further configured to: display an image on the touch screen by zooming out the image based on a determination that the information indicates that the apparatus moves away from the user; or display the image on the touch screen by zooming in the image based on a determination that the information indicates that the apparatus moves toward the user, and wherein if the number of touched spots is two or more and the touched spots move, the controller is further configured to deactivate the motion based zoom in and zoom out function, and display an image on the touch screen by zooming in or zooming out the image based on the motion of the touched spots. display an image on the touch screen by zooming out the image based on a determination that the information indicates that the apparatus moves away from the user; or display the image on the touch screen by zooming in the image based on a determination that the information indicates that the apparatus moves toward the user, and wherein if the number of touched spots is two or more and the touched spots move, the controller is further configured to deactivate the motion based zoom in and zoom out function, and display an image on the touch screen by zooming in or zooming out the image based on the motion of the touched spots.