Yes, turning off administrator permission can make your device less secure. It is important to weigh the risks and benefits before making such changes. Ensure that you have adequate security measures in place to compensate for the decreased security.