Now swift config is not passed if Swift disable

Change-Id: I17339c7339a9d6f786ba8c803f2778d8d666ed61
(cherry picked from commit 6904a54ff761145f68819500bdc000b4aedbcf09)