Supported Compute Shapes


Data Science supports specific Compute shapes for various resources in the service.

VM Compute shapes and GPU Compute shapes describe these shapes in detail.

 Tip

Sizing notebook sessions gives you tips about how to use shapes.

OCPUs represent physical CPU cores. Most CPU architectures, including x86, run two threads per physical core, so one OCPU is the equal of two vCPUs for x86-based compute. The cost per vCPU is half the cost of an OCPU, see Data Science pricing.

AMD CPU

Shape	OCPUs	GB Memory
VM.Standard.E3.Flex	1–64	1–1024 (dependent on OCPU count)
VM.Standard.E4.Flex	1–64	1–1024 (dependent on OCPU count)

For notebook sessions, the maximum memory for a standard flexible shape is 64 GB per OCPU up to the maximum allowed memory. For example, for two OCPUs, the maximum allowed memory is 2 * 64 = 128 GB. For 20 OCPUs, 20 * 64 = 1280 GB > 1024 GB. Therefore, for 20 OCPUs, the maximum allowed memory for both VM.Standard.E3. Flex and VM.Standard.E4.Flex is 1,024 GB.

Example:

OCPU	GB Memory
1	1-64
2	1-128
3	1-192
4	1–256

When you use standard flexible shapes for model deployments:

The minimum memory is 6 GB per OCPU used for the model server and load.
The maximum memory is 64 GB per OCPU up to the allowed memory for each shape. For example, maximum allowed memory for the VM.Standard.E3. Flex shape is 1,024 GB.

ARM CPU

Shape	OCPUs	GB Memory
VM.Standard.A1.Flex	1–80	1–1024 (dependent on OCPU count)

For notebook sessions, the maximum memory for a standard flexible shape is 64 GB per OCPU up to the maximum allowed memory (1024 GB). For example, for two OCPUs, the maximum allowed memory is 2 * 64 = 128 GB. For 20 OCPUs, 20 * 64 = 1280 GB > 1024 GB.

OCPU	GB Memory
1	1-64
2	1-128
3	1-192
4	1–256

Intel CPU (X9)

Shape	OCPUs	GB Memory
VM.Standard3.Flex	1–32	1–512 (dependent on OCPU count)
VM.Optimized3.Flex	1–18	1–256 (dependent on OCPU count)

Intel CPU (X7)

Shape	OCPUs	GB Memory
VM.Standard2.1	1	15
VM.Standard2.2	2	30
VM.Standard2.4	4	60
VM.Standard2.8	8	120
VM.Standard2.16	16	240
VM.Standard2.24	24	320

NVIDIA GPU

Shape	GPU Type	GPU Count	

GPU Memory (GB)

	OCPU Count	CPU Memory (GB)	Available Regions


VM.GPU2.1

(older generation)

	P100	1	16	12	72	Germany Central (Frankfurt), US East (Ashburn)
VM.GPU3.1	V100	1	16	6	90	

Germany Central (Frankfurt), Japan Central (Osaka), Japan East (Tokyo), South Korea Central (Seoul), UK South (London), US East (Ashburn), US West (San Jose)


VM.GPU3.2	V100	2	32	12	180	

Germany Central (Frankfurt), Japan Central (Osaka), Japan East (Tokyo), South Korea Central (Seoul), UK South (London), US East (Ashburn), US West (San Jose)


VM.GPU3.4	V100	4	64	24	360	

Germany Central (Frankfurt), Japan Central (Osaka), Japan East (Tokyo), South Korea Central (Seoul), UK South (London), US East (Ashburn), US West (San Jose)




BM.GPU2.2

	P100	2	32	28	192	

Germany Central (Frankfurt), US East (Ashburn)


BM.GPU3.8	V100	8	128	52	768	

Germany Central (Frankfurt), Japan Central (Osaka), Japan East (Tokyo), South Korea Central (Seoul), UK South (London), US East (Ashburn), US West (San Jose)


BM.GPU4.8	A100	8	320	64	2048	

Australia East (Sydney), Australia Southeast (Melbourne), Brazil East (Sao Paulo), Germany Central (Frankfurt), India West (Mumbai), Israel Central (Jerusalem), Israel Central (Jerusalem), Italy Northwest (Milan), Japan Central (Osaka), Japan East (Tokyo), Saudi Arabia West (Jeddah), Singapore (Singapore), South Korea Central (Seoul), UAE East (Dubai), US East (Ashburn), UK South (London), US West (Phoenix), US West (San Jose)


BM.GPUA10.4	A10	4	96	64	1024	

Canada Southeast (Toronto), France Central (Paris), Germany Central (Frankfurt), India West (Mumbai), Israel Central (Jerusalem), Japan Central (Osaka), Japan East (Tokyo), Saudi Arabia West (Jeddah), Singapore (Singapore), South Korea Central (Seoul), UK South (London), US East (Ashburn), US West (Phoenix), US West (San Jose)


VM.GPU.A10.1	A10	1	24	15	240	

Canada Southeast (Toronto), France Central (Paris), Germany Central (Frankfurt), India West (Mumbai), Israel Central (Jerusalem), Japan Central (Osaka), Japan East (Tokyo), Saudi Arabia West (Jeddah), Singapore (Singapore), South Korea Central (Seoul), UK South (London), US East (Ashburn), US West (Phoenix), US West (San Jose)


VM.GPU.A10.2	A10	2	48	30	480	

Canada Southeast (Toronto), France Central (Paris), Germany Central (Frankfurt), India West (Mumbai), Israel Central (Jerusalem), Japan Central (Osaka), Japan East (Tokyo), Saudi Arabia West (Jeddah), Singapore (Singapore), South Korea Central (Seoul), UK South (London), US East (Ashburn), US West (Phoenix), US West (San Jose)