Your Xorg is not setup correctly. You should only have Xorg on GPU0, none of the others. See my output below:
So far I only have the blacklist nouveau drivers working reliably with TensorFlow. When multiple GPU’s are in 100% compute mode they do not show up in the Nvidia control panel, so you cant start a miner, or control overclock and fan speeds. TensorFlow however does see them and it all works fine so far. I have not been looking into this much, as my TensorFlow rig is dual boot, when I am not using it for AI programming it reboots as a miner.
Below is my xorg file for the 7GPU 1080ti rig above. It is fully automated, headless and requires no monitor.
EDID: Extended Display Identification Data
The edid file is just a snapshot of a monitor (any monitor). The two lines below enable a custom edid in xorg.
Option “UseEdid” “False” Do not get the Edid for the connected monitor, there isn’t one
Option “CustomEDID” “DFP-0:/etc/X11/edid.bin” Use this edid file instead
The screen layout section sets up running xorg ONLY on GPU0, but Nvida sees all of them. This xorg.conf works fine with 1 to 7 GPU’s. Some entries are not required but I have not touched this file in a long time, it just works.
Section “ServerLayout”
Identifier “Layout0”
Screen 0 “Screen0” 0 0
Screen 1 “Screen1” RightOf “Screen0”
Screen 2 “Screen2” RightOf “Screen1”
Screen 3 “Screen3” RightOf “Screen2”
Screen 4 “Screen4” RightOf “Screen3”
Screen 5 “Screen5” RightOf “Screen4”
Screen 6 “Screen6” RightOf “Screen6”
InputDevice “Keyboard0” “CoreKeyboard”
InputDevice “Mouse0” “CorePointer”
Option “Xinerama” “0”
EndSection
Section “InputDevice”
# generated from default
Identifier “Mouse0”
Driver “mouse”
Option “Protocol” “auto”
Option “Device” “/dev/psaux”
Option “Emulate3Buttons” “no”
Option “ZAxisMapping” “4 5”
EndSection
Section “InputDevice”
# generated from default
Identifier “Keyboard0”
Driver “kbd”
EndSection
Section “Monitor”
Identifier “Monitor0”
VendorName “Unknown”
ModelName “Samsung S22C350”
HorizSync 30.0 - 81.0
VertRefresh 50.0 - 75.0
Option “DPMS”
EndSection
Section “Monitor”
Identifier “Monitor1”
VendorName “Unknown”
ModelName “Samsung S22C350”
HorizSync 30.0 - 81.0
VertRefresh 50.0 - 75.0
Option “DPMS”
EndSection
Section “Monitor”
Identifier “Monitor2”
VendorName “Unknown”
ModelName “Samsung S22C350”
HorizSync 30.0 - 81.0
VertRefresh 50.0 - 75.0
Option “DPMS”
EndSection
Section “Monitor”
Identifier “Monitor3”
VendorName “Unknown”
ModelName “Samsung S22C350”
HorizSync 30.0 - 81.0
VertRefresh 50.0 - 75.0
Option “DPMS”
EndSection
Section “Monitor”
Identifier “Monitor4”
VendorName “Unknown”
ModelName “Samsung S22C350”
HorizSync 30.0 - 81.0
VertRefresh 50.0 - 75.0
Option “DPMS”
EndSection
Section “Monitor”
Identifier “Monitor5”
VendorName “Unknown”
ModelName “Samsung S22C350”
HorizSync 30.0 - 81.0
VertRefresh 50.0 - 75.0
Option “DPMS”
EndSection
Section “Monitor”
Identifier “Monitor6”
VendorName “Unknown”
ModelName “Samsung S22C350”
HorizSync 30.0 - 81.0
VertRefresh 50.0 - 75.0
Option “DPMS”
EndSection
Section “Device”
Identifier “Device0”
Driver “nvidia”
VendorName “NVIDIA Corporation”
BoardName “Graphics Device”
BusID “PCI:1:0:0”
EndSection
Section “Device”
Identifier “Device1”
Driver “nvidia”
VendorName “NVIDIA Corporation”
BoardName “Graphics Device”
BusID “PCI:2:0:0”
EndSection
Section “Device”
Identifier “Device2”
Driver “nvidia”
VendorName “NVIDIA Corporation”
BoardName “Graphics Device”
BusID “PCI:4:0:0”
EndSection
Section “Device”
Identifier “Device3”
Driver “nvidia”
VendorName “NVIDIA Corporation”
BoardName “Graphics Device”
BusID “PCI:5:0:0”
EndSection
Section “Device”
Identifier “Device4”
Driver “nvidia”
VendorName “NVIDIA Corporation”
BoardName “Graphics Device”
BusID “PCI:6:0:0”
EndSection
Section “Device”
Identifier “Device5”
Driver “nvidia”
VendorName “NVIDIA Corporation”
BoardName “Graphics Device”
BusID “PCI:8:0:0”
EndSection
Section “Device”
Identifier “Device6”
Driver “nvidia”
VendorName “NVIDIA Corporation”
BoardName “Graphics Device”
BusID “PCI:9:0:0”
EndSection
Section “Screen”
Identifier “Screen0”
Device “Device0”
Monitor “Monitor0”
DefaultDepth 24
Option “Coolbits” “12”
Option “Stereo” “0”
Option “ConnectedMonitor” “DFP-0”
Option “nvidiaXineramaInfoOrder” “DFP-0”
Option “UseEdid” “False”
Option “CustomEDID” “DFP-0:/etc/X11/edid.bin”
Option “metamodes” “1920x1080”
SubSection “Display”
Depth 24
EndSubSection
EndSection
Section “Screen”
Identifier “Screen1”
Device “Device1”
Monitor “Monitor1”
DefaultDepth 24
Option “Coolbits” “12”
Option “Stereo” “0”
Option “nvidiaXineramaInfoOrder” “DFP-0”
Option “metamodes” “nvidia-auto-select +0+0”
SubSection “Display”
Depth 24
EndSubSection
EndSection
Section “Screen”
Identifier “Screen2”
Device “Device2”
Monitor “Monitor2”
DefaultDepth 24
Option “Coolbits” “12”
Option “Stereo” “0”
Option “nvidiaXineramaInfoOrder” “DFP-0”
Option “metamodes” “nvidia-auto-select +0+0”
SubSection “Display”
Depth 24
EndSubSection
EndSection
Section “Screen”
Identifier “Screen3”
Device “Device3”
Monitor “Monitor3”
DefaultDepth 24
Option “Coolbits” “12”
Option “Stereo” “0”
Option “nvidiaXineramaInfoOrder” “DFP-0”
Option “metamodes” “nvidia-auto-select +0+0”
SubSection “Display”
Depth 24
EndSubSection
EndSection
Section “Screen”
Identifier “Screen4”
Device “Device4”
Monitor “Monitor4”
DefaultDepth 24
Option “Coolbits” “12”
Option “Stereo” “0”
Option “nvidiaXineramaInfoOrder” “DFP-0”
Option “metamodes” “nvidia-auto-select +0+0”
SubSection “Display”
Depth 24
EndSubSection
EndSection
Section “Screen”
Identifier “Screen5”
Device “Device5”
Monitor “Monitor5”
DefaultDepth 24
Option “Coolbits” “12”
Option “Stereo” “0”
Option “nvidiaXineramaInfoOrder” “DFP-0”
Option “metamodes” “nvidia-auto-select +0+0”
SubSection “Display”
Depth 24
EndSubSection
EndSection
Section “Screen”
Identifier “Screen6”
Device “Device6”
Monitor “Monitor6”
DefaultDepth 24
Option “Coolbits” “12”
Option “Stereo” “0”
Option “nvidiaXineramaInfoOrder” “DFP-0”
Option “metamodes” “nvidia-auto-select +0+0”
SubSection “Display”
Depth 24
EndSubSection
EndSection
