Unable to use all cores.
I using this model on an Azure VM (128GB RAM, 16 Cores, AMD CPU, Ubuntu 22.04). I'm unable to utilise all cores. The pipeline step only utilises single core. Tried num_workers options with no success.
I am facing same issue.
Able to use all cores on an Intel CPU. Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz. These are the flags from /proc/cpuinfo :
fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves avx512_vnni arch_capabilities.
Can you please compare it with yours.