Yes, even though prime numbers enhance security, their security relies on large, unpredictable primes. If anyone is using weak or non-random primes, then cryptographic systems can be vulnerable to attacks and even can compromise their effectiveness and the security they provide.