There are multiple arguments as to why the JPY is a safe haven. Most notably, Japan has a positive net foreign asset position. The Japanese yen also has zero to negative interest rates, making it common for borrowing. When there’s a crisis, people sell their assets and borrow less.