Yes, the PSU fans should always be spinning if the Razer Core X or Razer Core X Chroma is powered on, has a compatible graphics card connected, and a Thunderbolt 3 or 4 cable plugged in.
If your GPU fans are not spinning check the manufacturer specifications as they may not be heating up to the point where the fans need to kick on.