A telescope can offer more powerful views than binoculars, you can get a decent telescope for about the same price as some binoculars, and telescopes look more impressive. But binoculars have a couple of advantages that make them worthy of consideration. First of all, they're extremely portable and can be ready to go at a moment's notice.
Many amateur astronomers have both a telescope and a pair of binoculars.
For example, if you come across a pair of binoculars labelled 7X50, that means that objects appear 7 times closer to you than they really are, and the outer objective lenses each measure 50mm in diameter. Since a bigger objective lens means that more light can enter the binoculars, the larger these lenses are, the brighter the objects will appear. Particularly in the case of stargazing, this means that more details can be brought out in the object being viewed. The greater the magnification, the more noticeable an unsteady image is. There are mounts available to hold binoculars, but then you start to lose the portability factor.