Criteria is plural, not singular

Excuse if I'm wrong about this (English is not my native language), but isn't criteria plural? And criterion singular. See http://www.merriam-webster.com/dictionary/criterion for example.