Question: is me neither correct grammar?
Answer: Me neither is idiomatic English. It is a set phrase, as @cindi said. The OED has it as colloquial, originally USA, meaning nor I.