Yes! The small, hand-held grinders are actually not grinders as such, as they use a blade to cut the beans into pieces. The large grinders on the other hand, use a conical burr which grinds the beans. Basically, the larger and more expensive grinders are often better, as they typically come with several different settings for how fine or coarse the beans can be ground.
The small grinders, on the other hand, are a lot cheaper and can, in many cases, still handle the task quite well – unless you are a proper coffee enthusiast. As mentioned before, your choice also depends on what types of coffee you brew. You can grind beans roughly on a hand grinder, but it can be more difficult, as you have to judge when to turn off the grinder when you think the beans are finished grinding.