You can change your settings to adjust who can invite you to a team on X for teams section of your Privacy and safety settings on x.com.