Artificial Intelligence Computing Leadership from NVIDIA
GPU in a VM pass-through setting
Hi All, My system environment is as below: Host system: Windows Server 2019 GPU: NVIDIA Titan RTX Guest system: Hyper-V Ubuntu Linux 18.04.2 LTS VM. I have done the GPU pass-through on my Host system to dismount the GPU and mount it to my Hyper-V Ubuntu Linux VM by referring to this documentation: [url]https://docs.nvidia.com/grid/5.0/grid-vgpu-user-guide/index.html#using-gpu-pass-through-windows-server-hyper-v[/url]. [quote]After assigning a GPU to a VM, install the NVIDIA graphics driver in the guest OS on the VM as explained in Installing the NVIDIA vGPU Software Graphics Driver[/quote] And according to the documentation, I am required to install the NVIDIA vGPU software graphic driver. But from [url]https://docs.nvidia.com/grid/latest/grid-vgpu-release-notes-microsoft-windows-server/index.html#hardware-configuration[/url] The Titan RTX GPU is not listed as the supported GPU, am I able to install the NVIDIA vGPU software with the Titan RTX GPU on the Hyper-V Ubuntu Linux VM? I am working on installing CUDA on my Hyper-V Ubuntu Linux VM and I am encounter the error as show below when running the nvidia-smi: [code]test-Virtual-Machine:~/NVIDIA_CUDA-10.1_Samples/bin/x86_64/linux/release$ nvidia-smi Unable to determine the device handle for GPU 8C8A:00:00.0: Unknown Error[/code] I am able to install CUDA but encounter the following error when running the CUDA sample binaries to verify the CUDA installation: [code]test-Virtual-Machine:~/NVIDIA_CUDA-10.1_Samples/bin/x86_64/linux/release$ ./deviceQuery ./deviceQuery Starting... CUDA Device Query (Runtime API) version (CUDART static linking) cudaGetDeviceCount returned 101 -> invalid device ordinal Result = FAIL test-Virtual-Machine:~/NVIDIA_CUDA-10.1_Samples/bin/x86_64/linux/release$ ./bandwidthTest [CUDA Bandwidth Test] - Starting... Running on... cudaGetDeviceProperties returned 101 -> invalid device ordinal CUDA error at bandwidthTest.cu:242 code=101(cudaErrorInvalidDevice) "cudaSetDevice(currentDevice)" [/code] For my case, what should I do in order for me to enable my Hyper-V VM to be able to use the GPU and run CUDA successfully? Thanks and regards, YiYang
Hi All,

My system environment is as below:
Host system: Windows Server 2019
GPU: NVIDIA Titan RTX
Guest system: Hyper-V Ubuntu Linux 18.04.2 LTS VM.

I have done the GPU pass-through on my Host system to dismount the GPU and mount it to my Hyper-V Ubuntu Linux VM by referring to this documentation: https://docs.nvidia.com/grid/5.0/grid-vgpu-user-guide/index.html#using-gpu-pass-through-windows-server-hyper-v.

After assigning a GPU to a VM, install the NVIDIA graphics driver in the guest OS on the VM as explained in Installing the NVIDIA vGPU Software Graphics Driver

And according to the documentation, I am required to install the NVIDIA vGPU software graphic driver.
But from https://docs.nvidia.com/grid/latest/grid-vgpu-release-notes-microsoft-windows-server/index.html#hardware-configuration
The Titan RTX GPU is not listed as the supported GPU, am I able to install the NVIDIA vGPU software with the Titan RTX GPU on the Hyper-V Ubuntu Linux VM?

I am working on installing CUDA on my Hyper-V Ubuntu Linux VM and I am encounter the error as show below when running the nvidia-smi:
test-Virtual-Machine:~/NVIDIA_CUDA-10.1_Samples/bin/x86_64/linux/release$ nvidia-smi 
Unable to determine the device handle for GPU 8C8A:00:00.0: Unknown Error

I am able to install CUDA but encounter the following error when running the CUDA sample binaries to verify the CUDA installation:
test-Virtual-Machine:~/NVIDIA_CUDA-10.1_Samples/bin/x86_64/linux/release$ ./deviceQuery
./deviceQuery Starting...

CUDA Device Query (Runtime API) version (CUDART static linking)

cudaGetDeviceCount returned 101
-> invalid device ordinal
Result = FAIL
test-Virtual-Machine:~/NVIDIA_CUDA-10.1_Samples/bin/x86_64/linux/release$ ./bandwidthTest
[CUDA Bandwidth Test] - Starting...
Running on...

cudaGetDeviceProperties returned 101
-> invalid device ordinal
CUDA error at bandwidthTest.cu:242 code=101(cudaErrorInvalidDevice) "cudaSetDevice(currentDevice)"


For my case, what should I do in order for me to enable my Hyper-V VM to be able to use the GPU and run CUDA successfully?

Thanks and regards,
YiYang

#1
Posted 07/17/2019 03:07 AM   
Hi The only GPUs that support vGPU are Tesla and the RTX 6000 & RTX 8000. The TITAN cannot be used with vGPU, so you will need to run the TITAN in Passthrough / DDA for your Ubuntu VM. As the TITAN doesn't support vGPU, you can use the standard driver from the NVIDIA drivers page: [url]https://www.nvidia.co.uk/Download/index.aspx?lang=en-uk[/url]. Regards MG
Hi

The only GPUs that support vGPU are Tesla and the RTX 6000 & RTX 8000. The TITAN cannot be used with vGPU, so you will need to run the TITAN in Passthrough / DDA for your Ubuntu VM.

As the TITAN doesn't support vGPU, you can use the standard driver from the NVIDIA drivers page: https://www.nvidia.co.uk/Download/index.aspx?lang=en-uk.

Regards

MG

#2
Posted 07/17/2019 08:27 AM   
Hi Sir, I have successfully done the GPU pass-through by following the instruction here:[url]https://docs.nvidia.com/grid/5.0/grid-vgpu-user-guide/index.html#using-gpu-pass-through-windows-server-hyper-v[/url] [quote]As the TITAN doesn't support vGPU, you can use the standard driver from the NVIDIA drivers page: https://www.nvidia.co.uk/Download/index.aspx?lang=en-uk.[/quote] I have tried to install the standard driver before. What I did was I installed CUDA first by following this documentation:[url]https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#ubuntu-installation[/url]. Then I downloaded the NVIDIA drivers from the page you suggested, but after installing the NVIDIA driver and reboot my Hyper-V Ubuntu Linux VM, my VM be cannot be boot and just stuck at the black screen. The NVIDIA drivers that I have downloaded and installed from the page for Titan RTX are the [b]Linux 64-bit[/b] Operating system and [b]Linux 64-bit Ubuntu 18.04[/b] Operating System. Thank You and Regards, YiYang
Hi Sir,

I have successfully done the GPU pass-through by following the instruction here:https://docs.nvidia.com/grid/5.0/grid-vgpu-user-guide/index.html#using-gpu-pass-through-windows-server-hyper-v


As the TITAN doesn't support vGPU, you can use the standard driver from the NVIDIA drivers page: https://www.nvidia.co.uk/Download/index.aspx?lang=en-uk.


I have tried to install the standard driver before.
What I did was I installed CUDA first by following this documentation:https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#ubuntu-installation.
Then I downloaded the NVIDIA drivers from the page you suggested, but after installing the NVIDIA driver and reboot my Hyper-V Ubuntu Linux VM, my VM be cannot be boot and just stuck at the black screen.
The NVIDIA drivers that I have downloaded and installed from the page for Titan RTX are the Linux 64-bit Operating system and Linux 64-bit Ubuntu 18.04 Operating System.

Thank You and Regards,
YiYang

#3
Posted 07/17/2019 10:14 AM   
Hi You should install the NVIDIA drivers in the OS first, that way anything that relies on the GPU will have access to it. Regarding the black screen ... If you were using a Hyper-V Console to connect to the VM, after installing the NVIDIA driver, you may now need to use a proper remoting protocol to connect to it. Depending on your requirements, maybe something like VNC. Or if you'd prefer to use RDP, then connect to the VM via SSH and install XRDP to allow RDP connectivity. Regards MG
Hi

You should install the NVIDIA drivers in the OS first, that way anything that relies on the GPU will have access to it.

Regarding the black screen ... If you were using a Hyper-V Console to connect to the VM, after installing the NVIDIA driver, you may now need to use a proper remoting protocol to connect to it. Depending on your requirements, maybe something like VNC. Or if you'd prefer to use RDP, then connect to the VM via SSH and install XRDP to allow RDP connectivity.

Regards

MG

#4
Posted 07/17/2019 02:11 PM   
Titan doesn't support virtualization at all.
Titan doesn't support virtualization at all.

#5
Posted 07/21/2019 05:17 PM   
Hi MrGRID, I have install the NVIDIA driver in my hyper-V Ubuntu Linux 18.04.2 LTS OS VM and I am connecting to the VM using RDP. The NVIDIA driver version I have installed is [b]430.34[/b] for [b]Linux 64-bit[/b] OS. But I still encounter the same error when running the nvidia-smi command as below: [code]test-Virtual-Machine:~/Desktop$ nvidia-smi Unable to determine the device handle for GPU 8C8A:00:00.0: Unknown Error[/code] Does this mean I am not able to use the Titan RTX GPU in my hyper-V Ubuntu Linux VM with the standard NVIDIA drivers? Thanks and Regards, YiYang
Hi MrGRID,

I have install the NVIDIA driver in my hyper-V Ubuntu Linux 18.04.2 LTS OS VM and I am connecting to the VM using RDP.
The NVIDIA driver version I have installed is 430.34 for Linux 64-bit OS.
But I still encounter the same error when running the nvidia-smi command as below:
test-Virtual-Machine:~/Desktop$ nvidia-smi 
Unable to determine the device handle for GPU 8C8A:00:00.0: Unknown Error

Does this mean I am not able to use the Titan RTX GPU in my hyper-V Ubuntu Linux VM with the standard NVIDIA drivers?

Thanks and Regards,
YiYang

#6
Posted 07/22/2019 05:40 AM   
Hi sschaber, [quote="sschaber"]Titan doesn't support virtualization at all. [/quote] Is it mean if I am using the Hyper-V Ubuntu Linux VM, I must have the vGPU drivers and NVIDIA GPU that support virtualization in order for the NVIDIA GPU to work in the VM? Thanks and regards, YiYang
Hi sschaber,

sschaber said:Titan doesn't support virtualization at all.


Is it mean if I am using the Hyper-V Ubuntu Linux VM, I must have the vGPU drivers and NVIDIA GPU that support virtualization in order for the NVIDIA GPU to work in the VM?

Thanks and regards,
YiYang

#7
Posted 07/22/2019 05:44 AM   
It means that Titan (consumer product) is not enabled for virtualization (including Passthrough) and therefore it is not working or at least not supported.
It means that Titan (consumer product) is not enabled for virtualization (including Passthrough) and therefore it is not working or at least not supported.

#8
Posted 07/23/2019 08:55 AM   
Hi sschaber, Does it means that only GPUs, like Tesla V100/P100, RTX6000/8000, can be passed through to the linux vm and work properly with standard NVIDIA driver? Should I install vGPU driver in linux vm or standard GPU driver is OK?
Hi sschaber,

Does it means that only GPUs, like Tesla V100/P100, RTX6000/8000, can be passed through to the linux vm and work properly with standard NVIDIA driver?

Should I install vGPU driver in linux vm or standard GPU driver is OK?

#9
Posted 09/05/2019 03:03 AM   
Hi The GPUs listed here are supported for vGPU: https://docs.nvidia.com/grid/latest/product-support-matrix/index.html Passthrough GPUs are Quadro P2000 and above. Don't confuse [b]vGPU[/b] with [b]Passthrough[/b], they are not the same. Regards MG
Hi

The GPUs listed here are supported for vGPU: https://docs.nvidia.com/grid/latest/product-support-matrix/index.html

Passthrough GPUs are Quadro P2000 and above.

Don't confuse vGPU with Passthrough, they are not the same.

Regards

MG

#10
Posted 09/05/2019 09:57 AM   
Scroll To Top

Add Reply