Toddlers usually hit themselves because they are annoyed with themselves. This frustration comes when they are unable to express their feelings. Toddlers may bang their heads when frustrated and it may be a natural response to smack their heads then.