Some Libertarians are also pacifists. They decline the use of any force. Libertarianism is broad enough to encompass pacifists. All oppose the initiation of force. Some Libertarians are militant.
Libertarianism is broad enough to encompass militants.
The common factor is opposition to the initiation of force. Freedom is sometimes defined as the absence of the initiation of force. The robber and the bully have initiated force and the condition of freedom doesn't exist unless there is an absence of the initiation of force. You have the right to free speech, but not to compel others to provide your forum. You have the right to earn a living, but not to compel others to provide your living.