Grammar Facts I Didn't Know About

"I didn't even know that was part of grammar." That was exactly what I thought one day when I stumbled upon a huge criteria vs. criterion debate. I felt like a horrible writer because I didn't even know that criterion is a word. Apparently criterion is singular and criteria is plural.This is such a totally new concept to me that I'm afraid to say either word.