Artificial Intelligence Computing Leadership from NVIDIA
Tesla T4 - Low FPS during video and overall session latency
GPU Tesla T4 CISCO UCS C240M5 VMware ESXI 6.7 CPU Xeon Gold 6146 x2 Citrix Xen Desktop 7.15 Citrix Receiver 1911 Citrix VDA 1912 LTSR GPU Driver Version 441.66 vGPU Profile used - grid_t4-2b and also grid_t4-2a ICA Network Latency is 1-2 MS ICA Round Trip Time is 5-100 MS Display is 3x 2560x1440p Monitors. Same behavior with only 1x 2560x1440p Playback via YouTube or any other stream is choppy, even at 1080p FPS is often around 15-18 which seems quite low. I've tried both codecs (H.264 4:4:4 and H.264 2:2:0) (same behavior) If anyone has any insight or ideas, let me know. https://www.nvidia.com/content/dam/en-zz/Solutions/design-visualization/solutions/resources/documents1/NVIDIA-vgpu-choosing-the-right-remoting-protocol-whitepaper.pdf
GPU Tesla T4
CISCO UCS C240M5
VMware ESXI 6.7
CPU Xeon Gold 6146 x2
Citrix Xen Desktop 7.15
Citrix Receiver 1911
Citrix VDA 1912 LTSR
GPU Driver Version 441.66
vGPU Profile used - grid_t4-2b and also grid_t4-2a
ICA Network Latency is 1-2 MS
ICA Round Trip Time is 5-100 MS
Display is 3x 2560x1440p Monitors. Same behavior with only 1x 2560x1440p

Playback via YouTube or any other stream is choppy, even at 1080p

FPS is often around 15-18 which seems quite low. I've tried both codecs (H.264 4:4:4 and H.264 2:2:0) (same behavior)

If anyone has any insight or ideas, let me know.

https://www.nvidia.com/content/dam/en-zz/Solutions/design-visualization/solutions/resources/documents1/NVIDIA-vgpu-choosing-the-right-remoting-protocol-whitepaper.pdf

#1
Posted 01/16/2020 10:39 PM   
First of all it would be helpful to figure out the difference between rendered frames and remoted frames. Check with "nvidia-smi encodersessions" how many frames are rendered and if you are properly using video codec with NVENC.
First of all it would be helpful to figure out the difference between rendered frames and remoted frames.
Check with "nvidia-smi encodersessions" how many frames are rendered and if you are properly using video codec with NVENC.

#2
Posted 01/17/2020 07:07 AM   
Thanks - See the output below and images. https://imgur.com/a/7nVDgEW https://imgur.com/a/UiUVV9k https://imgur.com/a/9KIvC5u GPU Session Process Codec H V Average Average # Idx Id Id Type Res Res FPS Latency(us) 0 65 2156 H.264 2560 1440 14 11513 0 66 2156 H.264 2560 1440 73 12596 0 67 2156 H.264 2560 1440 49 9348 0 65 2156 H.264 2560 1440 23 10527 0 66 2156 H.264 2560 1440 69 9903 0 67 2156 H.264 2560 1440 47 10926 0 65 2156 H.264 2560 1440 23 10621 0 66 2156 H.264 2560 1440 20 10323 0 67 2156 H.264 2560 1440 44 10221 0 65 2156 H.264 2560 1440 27 10590 0 66 2156 H.264 2560 1440 32 11146 0 67 2156 H.264 2560 1440 32 10844 0 65 2156 H.264 2560 1440 22 9287 0 66 2156 H.264 2560 1440 24 12186 0 67 2156 H.264 2560 1440 40 10161 0 65 2156 H.264 2560 1440 13 10905 0 66 2156 H.264 2560 1440 100 9909 0 67 2156 H.264 2560 1440 50 10152 0 65 2156 H.264 2560 1440 10 10218 0 66 2156 H.264 2560 1440 10 10152 0 67 2156 H.264 2560 1440 44 9993 0 65 2156 H.264 2560 1440 14 9605 0 66 2156 H.264 2560 1440 7 10288 0 67 2156 H.264 2560 1440 53 10146 0 65 2156 H.264 2560 1440 15 7578 0 66 2156 H.264 2560 1440 100 5728 0 67 2156 H.264 2560 1440 63 7646 0 65 2156 H.264 2560 1440 23 4546 0 66 2156 H.264 2560 1440 31 4433 0 67 2156 H.264 2560 1440 0 0 # GPU Session Process Codec H V Average Average # Idx Id Id Type Res Res FPS Latency(us) 0 65 2156 H.264 2560 1440 12 5196 0 66 2156 H.264 2560 1440 0 0 0 67 2156 H.264 2560 1440 0 0 0 65 2156 H.264 2560 1440 31 4512 0 66 2156 H.264 2560 1440 131 4454 0 67 2156 H.264 2560 1440 95 4504 0 65 2156 H.264 2560 1440 19 8485 0 66 2156 H.264 2560 1440 0 0 0 67 2156 H.264 2560 1440 0 0 0 65 2156 H.264 2560 1440 13 8737 0 66 2156 H.264 2560 1440 0 0 0 67 2156 H.264 2560 1440 0 0 0 65 2156 H.264 2560 1440 7 8644 0 66 2156 H.264 2560 1440 0 0 0 67 2156 H.264 2560 1440 0 0 [root@HBC-DC1-ESX13:~] nvidia-smi encodersessions # GPU Session Process Codec H V Average Average # Idx Id Id Type Res Res FPS Latency(us) 0 65 2156 H.264 2560 1440 15 10616 0 66 2156 H.264 2560 1440 0 0 0 67 2156 H.264 2560 1440 47 10615 0 65 2156 H.264 2560 1440 6 9249 0 66 2156 H.264 2560 1440 0 0 0 67 2156 H.264 2560 1440 57 9541 0 65 2156 H.264 2560 1440 11 10534 0 66 2156 H.264 2560 1440 0 0 0 67 2156 H.264 2560 1440 56 9757 0 65 2156 H.264 2560 1440 13 10009 0 66 2156 H.264 2560 1440 0 0 0 67 2156 H.264 2560 1440 54 9662 0 65 2156 H.264 2560 1440 9 9200 0 66 2156 H.264 2560 1440 0 0 0 67 2156 H.264 2560 1440 56 9585 0 65 2156 H.264 2560 1440 13 10333 0 66 2156 H.264 2560 1440 0 0 0 67 2156 H.264 2560 1440 53 9759 0 65 2156 H.264 2560 1440 11 9826 0 66 2156 H.264 2560 1440 0 0 0 67 2156 H.264 2560 1440 55 9981 0 65 2156 H.264 2560 1440 8 12013 0 66 2156 H.264 2560 1440 0 0 0 67 2156 H.264 2560 1440 51 9686 0 65 2156 H.264 2560 1440 8 10967 0 66 2156 H.264 2560 1440 0 0 0 67 2156 H.264 2560 1440 56 10536 0 65 2156 H.264 2560 1440 7 9894 0 66 2156 H.264 2560 1440 0 0 0 67 2156 H.264 2560 1440 54 9682 # GPU Session Process Codec H V Average Average # Idx Id Id Type Res Res FPS Latency(us) 0 65 2156 H.264 2560 1440 8 12130 0 66 2156 H.264 2560 1440 91 10868 0 67 2156 H.264 2560 1440 49 9755 0 65 2156 H.264 2560 1440 99 10070 0 66 2156 H.264 2560 1440 0 0 0 67 2156 H.264 2560 1440 59 9849 0 65 2156 H.264 2560 1440 13 11407 0 66 2156 H.264 2560 1440 0 0 0 67 2156 H.264 2560 1440 49 10220 0 65 2156 H.264 2560 1440 16 10127 0 66 2156 H.264 2560 1440 0 0 0 67 2156 H.264 2560 1440 54 10540 0 65 2156 H.264 2560 1440 12 11520 0 66 2156 H.264 2560 1440 0 0 0 67 2156 H.264 2560 1440 55 9914 0 65 2156 H.264 2560 1440 12 11352 0 66 2156 H.264 2560 1440 0 0 0 67 2156 H.264 2560 1440 54 10005 0 65 2156 H.264 2560 1440 10 11601 0 66 2156 H.264 2560 1440 0 0 0 67 2156 H.264 2560 1440 58 9936 0 65 2156 H.264 2560 1440 8 11175 0 66 2156 H.264 2560 1440 0 0 0 67 2156 H.264 2560 1440 56 9688 0 65 2156 H.264 2560 1440 13 10256 0 66 2156 H.264 2560 1440 0 0 0 67 2156 H.264 2560 1440 57 10131 0 65 2156 H.264 2560 1440 6 13011 0 66 2156 H.264 2560 1440 0 0 0 67 2156 H.264 2560 1440 60 9963
Thanks - See the output below and images.


https://imgur.com/a/7nVDgEW


https://imgur.com/a/UiUVV9k


https://imgur.com/a/9KIvC5u

GPU Session Process Codec H V Average Average
# Idx Id Id Type Res Res FPS Latency(us)
0 65 2156 H.264 2560 1440 14 11513
0 66 2156 H.264 2560 1440 73 12596
0 67 2156 H.264 2560 1440 49 9348
0 65 2156 H.264 2560 1440 23 10527
0 66 2156 H.264 2560 1440 69 9903
0 67 2156 H.264 2560 1440 47 10926
0 65 2156 H.264 2560 1440 23 10621
0 66 2156 H.264 2560 1440 20 10323
0 67 2156 H.264 2560 1440 44 10221
0 65 2156 H.264 2560 1440 27 10590
0 66 2156 H.264 2560 1440 32 11146
0 67 2156 H.264 2560 1440 32 10844
0 65 2156 H.264 2560 1440 22 9287
0 66 2156 H.264 2560 1440 24 12186
0 67 2156 H.264 2560 1440 40 10161
0 65 2156 H.264 2560 1440 13 10905
0 66 2156 H.264 2560 1440 100 9909
0 67 2156 H.264 2560 1440 50 10152
0 65 2156 H.264 2560 1440 10 10218
0 66 2156 H.264 2560 1440 10 10152
0 67 2156 H.264 2560 1440 44 9993
0 65 2156 H.264 2560 1440 14 9605
0 66 2156 H.264 2560 1440 7 10288
0 67 2156 H.264 2560 1440 53 10146
0 65 2156 H.264 2560 1440 15 7578
0 66 2156 H.264 2560 1440 100 5728
0 67 2156 H.264 2560 1440 63 7646
0 65 2156 H.264 2560 1440 23 4546
0 66 2156 H.264 2560 1440 31 4433
0 67 2156 H.264 2560 1440 0 0
# GPU Session Process Codec H V Average Average
# Idx Id Id Type Res Res FPS Latency(us)
0 65 2156 H.264 2560 1440 12 5196
0 66 2156 H.264 2560 1440 0 0
0 67 2156 H.264 2560 1440 0 0
0 65 2156 H.264 2560 1440 31 4512
0 66 2156 H.264 2560 1440 131 4454
0 67 2156 H.264 2560 1440 95 4504
0 65 2156 H.264 2560 1440 19 8485
0 66 2156 H.264 2560 1440 0 0
0 67 2156 H.264 2560 1440 0 0
0 65 2156 H.264 2560 1440 13 8737
0 66 2156 H.264 2560 1440 0 0
0 67 2156 H.264 2560 1440 0 0
0 65 2156 H.264 2560 1440 7 8644
0 66 2156 H.264 2560 1440 0 0
0 67 2156 H.264 2560 1440 0 0
[root@HBC-DC1-ESX13:~] nvidia-smi encodersessions
# GPU Session Process Codec H V Average Average
# Idx Id Id Type Res Res FPS Latency(us)
0 65 2156 H.264 2560 1440 15 10616
0 66 2156 H.264 2560 1440 0 0
0 67 2156 H.264 2560 1440 47 10615
0 65 2156 H.264 2560 1440 6 9249
0 66 2156 H.264 2560 1440 0 0
0 67 2156 H.264 2560 1440 57 9541
0 65 2156 H.264 2560 1440 11 10534
0 66 2156 H.264 2560 1440 0 0
0 67 2156 H.264 2560 1440 56 9757
0 65 2156 H.264 2560 1440 13 10009
0 66 2156 H.264 2560 1440 0 0
0 67 2156 H.264 2560 1440 54 9662
0 65 2156 H.264 2560 1440 9 9200
0 66 2156 H.264 2560 1440 0 0
0 67 2156 H.264 2560 1440 56 9585
0 65 2156 H.264 2560 1440 13 10333
0 66 2156 H.264 2560 1440 0 0
0 67 2156 H.264 2560 1440 53 9759
0 65 2156 H.264 2560 1440 11 9826
0 66 2156 H.264 2560 1440 0 0
0 67 2156 H.264 2560 1440 55 9981
0 65 2156 H.264 2560 1440 8 12013
0 66 2156 H.264 2560 1440 0 0
0 67 2156 H.264 2560 1440 51 9686
0 65 2156 H.264 2560 1440 8 10967
0 66 2156 H.264 2560 1440 0 0
0 67 2156 H.264 2560 1440 56 10536
0 65 2156 H.264 2560 1440 7 9894
0 66 2156 H.264 2560 1440 0 0
0 67 2156 H.264 2560 1440 54 9682
# GPU Session Process Codec H V Average Average
# Idx Id Id Type Res Res FPS Latency(us)
0 65 2156 H.264 2560 1440 8 12130
0 66 2156 H.264 2560 1440 91 10868
0 67 2156 H.264 2560 1440 49 9755
0 65 2156 H.264 2560 1440 99 10070
0 66 2156 H.264 2560 1440 0 0
0 67 2156 H.264 2560 1440 59 9849
0 65 2156 H.264 2560 1440 13 11407
0 66 2156 H.264 2560 1440 0 0
0 67 2156 H.264 2560 1440 49 10220
0 65 2156 H.264 2560 1440 16 10127
0 66 2156 H.264 2560 1440 0 0
0 67 2156 H.264 2560 1440 54 10540
0 65 2156 H.264 2560 1440 12 11520
0 66 2156 H.264 2560 1440 0 0
0 67 2156 H.264 2560 1440 55 9914
0 65 2156 H.264 2560 1440 12 11352
0 66 2156 H.264 2560 1440 0 0
0 67 2156 H.264 2560 1440 54 10005
0 65 2156 H.264 2560 1440 10 11601
0 66 2156 H.264 2560 1440 0 0
0 67 2156 H.264 2560 1440 58 9936
0 65 2156 H.264 2560 1440 8 11175
0 66 2156 H.264 2560 1440 0 0
0 67 2156 H.264 2560 1440 56 9688
0 65 2156 H.264 2560 1440 13 10256
0 66 2156 H.264 2560 1440 0 0
0 67 2156 H.264 2560 1440 57 10131
0 65 2156 H.264 2560 1440 6 13011
0 66 2156 H.264 2560 1440 0 0
0 67 2156 H.264 2560 1440 60 9963

#3
Posted 01/17/2020 02:07 PM   
Hi Your encoding latency is all over the place, and it’s actually quite high. Can you try something not from YouTube. Use a local source, something loaded locally on to the VM to rule out your streaming source. What are you using as a Client and how is it connected to the network? If WiFi, use a physical cable. You may also want to try a completely different network connection as well. Ping times don’t tell the whole story. Regards MG
Hi

Your encoding latency is all over the place, and it’s actually quite high. Can you try something not from YouTube. Use a local source, something loaded locally on to the VM to rule out your streaming source.

What are you using as a Client and how is it connected to the network? If WiFi, use a physical cable. You may also want to try a completely different network connection as well. Ping times don’t tell the whole story.

Regards

MG

#4
Posted 01/18/2020 10:24 AM   
Scroll To Top

Add Reply