Question: how smart do you have to be to be a theoretical physicist?
Answer: You have to be smart enough to understand if you like physics (and math) as much as needed in order to study it as hard as you can, because you will need to do it if you want to "go into theoretical physics".