Create keystore if there is not exist

Signed-off-by: Manula Thantriwatte <manula@apache.org>