They certainly can. It's normal for your self-esteem to be lower after being around a narcissist for a while. Fortunately, you can rebuild it. Spend some time building yourself up so you can regain your confidence.