NVIDIA
Max M10 boards per server
Can someone explain the general limitation of 2 M10's per server. Is it a BIOS issue, RAM, CPU, what is the limitation. If I have a server that can fit 6 GPU's per server what is the rational behind only supporting 2 per server? https://www.nvidia.com/object/grid-certified-servers.html We are using a SuperMicro SYS-2028GR-TRHT, which have enough slots for 6 GPU's and currently running 4 K2's per server without issue. https://www.supermicro.com/products/system/2u/2028/sys-2028gr-trht.cfm looking to move to the M10-2Q profile and would like to get better density than 32 users per server (32GB per M10 / 2GB per VM) x 2 M10 boards.
Can someone explain the general limitation of 2 M10's per server. Is it a BIOS issue, RAM, CPU, what is the limitation. If I have a server that can fit 6 GPU's per server what is the rational behind only supporting 2 per server?


https://www.nvidia.com/object/grid-certified-servers.html


We are using a SuperMicro SYS-2028GR-TRHT, which have enough slots for 6 GPU's and currently running 4 K2's per server without issue.

https://www.supermicro.com/products/system/2u/2028/sys-2028gr-trht.cfm


looking to move to the M10-2Q profile and would like to get better density than 32 users per server (32GB per M10 / 2GB per VM) x 2 M10 boards.

#1
Posted 10/08/2018 06:53 PM   
Hi, M10 has 4GPUs on a single board. Issue is the number of available PCI devices per physical host. 3 M10s = 12 GPUs!!! regards Simon
Hi,

M10 has 4GPUs on a single board. Issue is the number of available PCI devices per physical host. 3 M10s = 12 GPUs!!!

regards

Simon

#2
Posted 10/08/2018 07:26 PM   
I would think the number of available slots, power, and cooling would be the main limiting factors. Currently,you also cannot/should not mix GPU models (like an M10 and an M60) on the same server.
I would think the number of available slots, power, and cooling would be the main limiting factors. Currently,you also cannot/should not mix GPU models (like an M10 and an M60) on the same server.

-=Tobias

#3
Posted 10/10/2018 10:10 PM   
[b]Don't forget the M10 and M60 are both Double-Height GPU's. I do not believe there is a server on the market that will support 6 of them.[/b] We use Dell R730's (They support 2 Cards) and we have a new Dell R740 and it supports 3 Cards. As suggested do NOT try and mix GPU Cards in a single server.
Don't forget the M10 and M60 are both Double-Height GPU's.

I do not believe there is a server on the market that will support 6 of them.


We use Dell R730's (They support 2 Cards) and we have a new Dell R740 and it supports 3 Cards.

As suggested do NOT try and mix GPU Cards in a single server.

#4
Posted 10/25/2018 03:44 PM   
Most server support 2 x M10 GPU cards only due to running out of PCI Express lanes (PCIe x16 needed).
Most server support 2 x M10 GPU cards only due to running out of PCI Express lanes (PCIe x16 needed).

#5
Posted 01/16/2019 11:45 AM   
I'm afraid you are at your max, you can't do more than 2 M10's or 4 M60 in your current hardware, this is a bios limit for devices. Each GPU is another device, as Simon already pointed out. Check https://www.supermicro.com/support/resources/gpu/ for the current state of supported graphics hardware in their server range, for yours and more servers in that range, it has a remark of "1" and "7" for both M10 and M60 columns: 1, 2, 3. Note: Additional Supermicro Power cable is required per board for K80/M60 support 7. Note: Indicated systems can only support up to 2x M10 and 4x M60 GPU.
I'm afraid you are at your max, you can't do more than 2 M10's or 4 M60 in your current hardware, this is a bios limit for devices. Each GPU is another device, as Simon already pointed out.

Check https://www.supermicro.com/support/resources/gpu/ for the current state of supported graphics hardware in their server range, for yours and more servers in that range, it has a remark of "1" and "7" for both M10 and M60 columns:

1, 2, 3. Note: Additional Supermicro Power cable is required per board for K80/M60 support

7. Note: Indicated systems can only support up to 2x M10 and 4x M60 GPU.

Hans Kraaijeveld, Senior Project Engineer, EUC Consultant, Cliënt ICT Groep
Twitter: @hanskraaijeveld
Blog: https://www.plonius.com

#6
Posted 01/24/2019 01:21 PM   
Scroll To Top

Add Reply