If you develop a full on phobia of public speaking (not just being a bit nervous), this is called glossophobia.