Added below definition for font files in the same server block. Problem solved.
location ~* .(eot|ttf|woff|woff2|otf)$ {
try_files $uri =404;
expires 1M;
add_header Cache-Control "public";
add_header Access-Control-Allow-Origin *;
}