Harassment is not itself a violent crime. Assault or battery (different states use different terms) would be, and if you did shove someone, the officer could have cited/charged you with assault or battery. But harassment itself is not a violent crime; the officer did you a favor (whether he meant to or not) in how he charged you.