Skip to content
New issue
Jump to bottom

linux: Intel E810 network adapter does not work – missing driver ICE #3199

Closed
pmenzel opened this issue Jan 24, 2025 · 4 comments
Closed

linux: Intel E810 network adapter does not work – missing driver ICE #3199

pmenzel opened this issue Jan 24, 2025 · 4 comments

Comments

@pmenzel
Copy link
Collaborator

pmenzel commented Jan 24, 2025 

@lucy:~$ lspci -nn -k -s 64:
64:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller E810-XXV for SFP [8086:159b] (rev 02)
        Subsystem: Intel Corporation Ethernet 25G 2P E810-XXV Adapter [8086:0002]
64:00.1 Ethernet controller [0200]: Intel Corporation Ethernet Controller E810-XXV for SFP [8086:159b] (rev 02)
        Subsystem: Intel Corporation Ethernet 25G 2P E810-XXV Adapter [8086:0002]
@lucy:~$ grep CONFIG_ICE /boot/config-*
/boot/config-5.15.112.mx64.449:# CONFIG_ICE is not set
/boot/config-5.15.131.mx64.457:# CONFIG_ICE is not set
/boot/config-5.15.160.mx64.476:# CONFIG_ICE is not set
/boot/config-5.15.77.mx64.440:# CONFIG_ICE is not set
/boot/config-5.15.86.mx64.443:# CONFIG_ICE is not set
/boot/config-5.15.94.mx64.447:# CONFIG_ICE is not set
/boot/config-6.1.53.mx64.458:# CONFIG_ICE is not set
/boot/config-6.6.12.mx64.461:# CONFIG_ICE is not set
/boot/config-6.6.35.mx64.477:# CONFIG_ICE is not set
pmenzel added a commit to mariux64/linux that referenced this issue Jan 24, 2025
@pmenzel
config-mpi: Build driver *ice* for Intel Ethernet Connection E800 Ser…
1ac5a53 
…ies Support as module

The new server *lucy*, , includes two Intel E810-XXV adapters:

    @lucy:~$ lspci -nn -k -s 64:
    64:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller E810-XXV for SFP [8086:159b] (rev 02)
            Subsystem: Intel Corporation Ethernet 25G 2P E810-XXV Adapter [8086:0002]
    64:00.1 Ethernet controller [0200]: Intel Corporation Ethernet Controller E810-XXV for SFP [8086:159b] (rev 02)
            Subsystem: Intel Corporation Ethernet 25G 2P E810-XXV Adapter [8086:0002]

So, build the driver as a module.

> config ICE
>         tristate "Intel(R) Ethernet Connection E800 Series Support"
>         default n
>         depends on PCI_MSI
>         depends on PTP_1588_CLOCK_OPTIONAL
>         depends on GNSS || GNSS = n
>         select AUXILIARY_BUS
>         select DIMLIB
>         select LIBIE
>         select NET_DEVLINK
>         select PACKING
>         select PLDMFW
>         select DPLL
>         help
>           This driver supports Intel(R) Ethernet Connection E800 Series of
>           devices.  For more information on how to identify your adapter, go
>           to the Adapter & Driver ID Guide that can be located at:
>
>           <http://support.intel.com>
>
>           More specific information on configuring the driver is in
>           <file:Documentation/networking/device_drivers/ethernet/intel/ice.rst>.
>
>           To compile this driver as a module, choose M here. The module
>           will be called ice.

The firmware files are already included in the bee package *linux-firmware*:

    $ ls /lib/firmware/intel/ice
    ddp  ddp-comms	ddp-lag  ddp-wireless_edge

Resolves: mariux64/bee-files#3199
pmenzel added a commit that referenced this issue Jan 24, 2025
@pmenzel
linux: Add version 6.12.11-479
84d1baf 
Has *ice* driver enabled.

/lib/modules/6.12.11.mx64.479/kernel/drivers/net/ethernet/intel/ice/ice.ko

Resolves: #3199
@pmenzel
Copy link
Collaborator Author

pmenzel commented Jan 25, 2025

With the ice driver the devices is detected and 10 Gbit/s is negotiated.

But the driver logs:

$ dmesg --level alert,crit,err,warn -T
[Fri Jan 24 15:55:01 2025] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!
[Fri Jan 24 15:55:07 2025] Could not retrieve perf counters (-19)
[Fri Jan 24 15:55:08 2025] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled
[Fri Jan 24 15:55:08 2025] scsi 0:0:4:0: set ignore_delay_remove for handle(0x0012)
[Fri Jan 24 15:55:14 2025] wmi_bus wmi_bus-PNP0C14:00: [Firmware Bug]: WQBC data block query control method not found
[Fri Jan 24 15:55:15 2025] ice 0000:64:00.0: Direct firmware load for intel/ice/ddp/ice.pkg failed with error -2
[Fri Jan 24 15:55:15 2025] ice 0000:64:00.0: The DDP package file was not found or could not be read. Entering Safe Mode
[Fri Jan 24 15:55:15 2025] ice 0000:64:00.0: Fail during requesting FW: -2
[Fri Jan 24 15:55:15 2025] ice 0000:64:00.0: not enough device MSI-X vectors. wanted = 66, available = 2
[Fri Jan 24 15:55:15 2025] ice 0000:64:00.0: RDMA is not supported on this device
[Fri Jan 24 15:55:15 2025] ice 0000:64:00.1: Direct firmware load for intel/ice/ddp/ice.pkg failed with error -2
[Fri Jan 24 15:55:15 2025] ice 0000:64:00.1: The DDP package file was not found or could not be read. Entering Safe Mode
[Fri Jan 24 15:55:15 2025] ice 0000:64:00.1: Fail during requesting FW: -2
[Fri Jan 24 15:55:15 2025] ice 0000:64:00.1: not enough device MSI-X vectors. wanted = 66, available = 2
[Fri Jan 24 15:55:15 2025] ice 0000:64:00.1: RDMA is not supported on this device

After creating the symbolic link with

pmenzel@lucy:/lib/firmware/intel/ice/ddp$ sudo ln -s ice-1.3.30.0.pkg ice.pkg

and rebooting the system, the network does not work anymore. More next week.

https://bugs.launchpad.net/ubuntu/+source/linux-firmware/+bug/1960839

@pmenzel
Copy link
Collaborator Author

pmenzel commented Jan 27, 2025

Turns out Linux 6.12.11 was disted away for yet unknown reasons.

@pmenzel
Copy link
Collaborator Author

pmenzel commented Jan 27, 2025 

pmenzel@lucy:~$ date; wget -O /dev/null https://owww.molgen.mpg.de/~buczek/ubuntu-20.04.1-desktop-amd64.iso
Mon Jan 27 12:57:44 CET 2025
--2025-01-27 12:57:44--  https://owww.molgen.mpg.de/~buczek/ubuntu-20.04.1-desktop-amd64.iso
Resolving owww.molgen.mpg.de... 141.14.27.32
Connecting to owww.molgen.mpg.de|141.14.27.32|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2785017856 (2.6G) [application/x-iso9660-image]
Saving to: ‘/dev/null’

/dev/null                 100%[=====================================>]   2.59G   542MB/s    in 5.5s    

2025-01-27 12:57:50 (479 MB/s) - ‘/dev/null’ saved [2785017856/2785017856]

pmenzel@lucy:~$ date; wget -O /dev/null https://owww.molgen.mpg.de/~buczek/ubuntu-20.04.1-desktop-amd64.iso
Mon Jan 27 12:57:51 CET 2025
--2025-01-27 12:57:51--  https://owww.molgen.mpg.de/~buczek/ubuntu-20.04.1-desktop-amd64.iso
Resolving owww.molgen.mpg.de... 141.14.27.32
Connecting to owww.molgen.mpg.de|141.14.27.32|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2785017856 (2.6G) [application/x-iso9660-image]
Saving to: ‘/dev/null’

/dev/null                 100%[=====================================>]   2.59G   581MB/s    in 4.5s    

2025-01-27 12:57:56 (586 MB/s) - ‘/dev/null’ saved [2785017856/2785017856]

pmenzel@lucy:~$ date; iperf3 -c iperf3.molgen.mpg.de
Mon Jan 27 12:58:09 CET 2025
Connecting to host iperf3.molgen.mpg.de, port 5201
[  5] local 141.14.19.228 port 33990 connected to 141.14.27.109 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  1.02 GBytes  8.78 Gbits/sec   35    846 KBytes       
[  5]   1.00-2.00   sec  1.02 GBytes  8.76 Gbits/sec    9    754 KBytes       
[  5]   2.00-3.00   sec  1.09 GBytes  9.37 Gbits/sec    1   1.15 MBytes       
[  5]   3.00-4.00   sec  1.09 GBytes  9.37 Gbits/sec    6   1.12 MBytes       
[  5]   4.00-5.00   sec  1.09 GBytes  9.36 Gbits/sec   11   1.10 MBytes       
[  5]   5.00-6.00   sec  1.09 GBytes  9.36 Gbits/sec    2   1.06 MBytes       
[  5]   6.00-7.00   sec  1.09 GBytes  9.37 Gbits/sec    6   1.15 MBytes       
[  5]   7.00-8.00   sec  1.09 GBytes  9.36 Gbits/sec    6    980 KBytes       
[  5]   8.00-9.00   sec  1.09 GBytes  9.37 Gbits/sec    5   1.11 MBytes       
[  5]   9.00-10.00  sec  1.09 GBytes  9.37 Gbits/sec    6   1.03 MBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  10.8 GBytes  9.25 Gbits/sec   87             sender
[  5]   0.00-10.03  sec  10.8 GBytes  9.22 Gbits/sec                  receiver

iperf Done.
pmenzel@lucy:~$ date; iperf3 -c iperf3.molgen.mpg.de
Mon Jan 27 12:58:21 CET 2025
Connecting to host iperf3.molgen.mpg.de, port 5201
[  5] local 141.14.19.228 port 42282 connected to 141.14.27.109 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  1.09 GBytes  9.40 Gbits/sec   50   1.25 MBytes       
[  5]   1.00-2.00   sec  1.09 GBytes  9.35 Gbits/sec    8   1.20 MBytes       
[  5]   2.00-3.00   sec  1.06 GBytes  9.11 Gbits/sec    9    755 KBytes       
[  5]   3.00-4.00   sec  1.01 GBytes  8.71 Gbits/sec    8    602 KBytes       
[  5]   4.00-5.00   sec  1.05 GBytes  9.04 Gbits/sec    5    513 KBytes       
[  5]   5.00-6.00   sec  1.04 GBytes  8.96 Gbits/sec    3    861 KBytes       
[  5]   6.00-7.00   sec  1.01 GBytes  8.68 Gbits/sec    4   1.02 MBytes       
[  5]   7.00-8.00   sec  1.06 GBytes  9.11 Gbits/sec    6   1022 KBytes       
[  5]   8.00-9.00   sec  1.04 GBytes  8.94 Gbits/sec   13    983 KBytes       
[  5]   9.00-10.00  sec  1.06 GBytes  9.10 Gbits/sec   18   1.21 MBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  10.5 GBytes  9.04 Gbits/sec  124             sender
[  5]   0.00-10.00  sec  10.5 GBytes  9.04 Gbits/sec                  receiver

iperf Done.
pmenzel@lucy:~$ date; iperf3 -P4 -c iperf3.molgen.mpg.de
Mon Jan 27 12:59:05 CET 2025
Connecting to host iperf3.molgen.mpg.de, port 5201
[  5] local 141.14.19.228 port 52930 connected to 141.14.27.109 port 5201
[  7] local 141.14.19.228 port 52942 connected to 141.14.27.109 port 5201
[  9] local 141.14.19.228 port 52956 connected to 141.14.27.109 port 5201
[ 11] local 141.14.19.228 port 52972 connected to 141.14.27.109 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   280 MBytes  2.35 Gbits/sec    6    501 KBytes       
[  7]   0.00-1.00   sec   279 MBytes  2.34 Gbits/sec   12    375 KBytes       
[  9]   0.00-1.00   sec   282 MBytes  2.37 Gbits/sec    0    806 KBytes       
[ 11]   0.00-1.00   sec   282 MBytes  2.36 Gbits/sec    7    469 KBytes       
[SUM]   0.00-1.00   sec  1.10 GBytes  9.42 Gbits/sec   25             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec   280 MBytes  2.35 Gbits/sec    8    362 KBytes       
[  7]   1.00-2.00   sec   280 MBytes  2.35 Gbits/sec    7    345 KBytes       
[  9]   1.00-2.00   sec   280 MBytes  2.35 Gbits/sec    4    457 KBytes       
[ 11]   1.00-2.00   sec   278 MBytes  2.33 Gbits/sec    9    346 KBytes       
[SUM]   1.00-2.00   sec  1.09 GBytes  9.38 Gbits/sec   28             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec   278 MBytes  2.33 Gbits/sec   21    238 KBytes       
[  7]   2.00-3.00   sec   280 MBytes  2.35 Gbits/sec   17    270 KBytes       
[  9]   2.00-3.00   sec   278 MBytes  2.34 Gbits/sec   24    327 KBytes       
[ 11]   2.00-3.00   sec   280 MBytes  2.35 Gbits/sec   22    304 KBytes       
[SUM]   2.00-3.00   sec  1.09 GBytes  9.36 Gbits/sec   84             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec   280 MBytes  2.35 Gbits/sec   10    402 KBytes       
[  7]   3.00-4.00   sec   281 MBytes  2.36 Gbits/sec    3    478 KBytes       
[  9]   3.00-4.00   sec   277 MBytes  2.33 Gbits/sec    7    362 KBytes       
[ 11]   3.00-4.00   sec   278 MBytes  2.33 Gbits/sec    6    375 KBytes       
[SUM]   3.00-4.00   sec  1.09 GBytes  9.37 Gbits/sec   26             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec   279 MBytes  2.34 Gbits/sec    5    427 KBytes       
[  7]   4.00-5.00   sec   276 MBytes  2.32 Gbits/sec   11    396 KBytes       
[  9]   4.00-5.00   sec   281 MBytes  2.36 Gbits/sec    4    499 KBytes       
[ 11]   4.00-5.00   sec   281 MBytes  2.36 Gbits/sec    4    510 KBytes       
[SUM]   4.00-5.00   sec  1.09 GBytes  9.38 Gbits/sec   24             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   5.00-6.00   sec   282 MBytes  2.36 Gbits/sec   10    444 KBytes       
[  7]   5.00-6.00   sec   280 MBytes  2.35 Gbits/sec   14    474 KBytes       
[  9]   5.00-6.00   sec   279 MBytes  2.34 Gbits/sec    5    451 KBytes       
[ 11]   5.00-6.00   sec   277 MBytes  2.33 Gbits/sec    5    397 KBytes       
[SUM]   5.00-6.00   sec  1.09 GBytes  9.38 Gbits/sec   34             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   6.00-7.00   sec   274 MBytes  2.30 Gbits/sec    5    406 KBytes       
[  7]   6.00-7.00   sec   278 MBytes  2.33 Gbits/sec    5    420 KBytes       
[  9]   6.00-7.00   sec   275 MBytes  2.31 Gbits/sec   19    352 KBytes       
[ 11]   6.00-7.00   sec   277 MBytes  2.32 Gbits/sec    5    404 KBytes       
[SUM]   6.00-7.00   sec  1.08 GBytes  9.26 Gbits/sec   34             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   7.00-8.00   sec   272 MBytes  2.28 Gbits/sec    6    187 KBytes       
[  7]   7.00-8.00   sec   271 MBytes  2.28 Gbits/sec    2    379 KBytes       
[  9]   7.00-8.00   sec   272 MBytes  2.28 Gbits/sec   17    324 KBytes       
[ 11]   7.00-8.00   sec   273 MBytes  2.29 Gbits/sec    5    359 KBytes       
[SUM]   7.00-8.00   sec  1.06 GBytes  9.12 Gbits/sec   30             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   8.00-9.00   sec   269 MBytes  2.25 Gbits/sec   35    392 KBytes       
[  7]   8.00-9.00   sec   270 MBytes  2.26 Gbits/sec    2    428 KBytes       
[  9]   8.00-9.00   sec   267 MBytes  2.24 Gbits/sec   31    303 KBytes       
[ 11]   8.00-9.00   sec   266 MBytes  2.23 Gbits/sec   26    359 KBytes       
[SUM]   8.00-9.00   sec  1.05 GBytes  8.99 Gbits/sec   94             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   9.00-10.00  sec   272 MBytes  2.28 Gbits/sec    1    513 KBytes       
[  7]   9.00-10.00  sec   269 MBytes  2.25 Gbits/sec    2    522 KBytes       
[  9]   9.00-10.00  sec   271 MBytes  2.28 Gbits/sec   12    501 KBytes       
[ 11]   9.00-10.00  sec   271 MBytes  2.27 Gbits/sec   30    468 KBytes       
[SUM]   9.00-10.00  sec  1.06 GBytes  9.08 Gbits/sec   45             
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  2.70 GBytes  2.32 Gbits/sec  107             sender
[  5]   0.00-10.00  sec  2.70 GBytes  2.32 Gbits/sec                  receiver
[  7]   0.00-10.00  sec  2.70 GBytes  2.32 Gbits/sec   75             sender
[  7]   0.00-10.00  sec  2.70 GBytes  2.32 Gbits/sec                  receiver
[  9]   0.00-10.00  sec  2.70 GBytes  2.32 Gbits/sec  123             sender
[  9]   0.00-10.00  sec  2.70 GBytes  2.32 Gbits/sec                  receiver
[ 11]   0.00-10.00  sec  2.70 GBytes  2.32 Gbits/sec  119             sender
[ 11]   0.00-10.00  sec  2.70 GBytes  2.32 Gbits/sec                  receiver
[SUM]   0.00-10.00  sec  10.8 GBytes  9.27 Gbits/sec  424             sender
[SUM]   0.00-10.00  sec  10.8 GBytes  9.27 Gbits/sec                  receiver

iperf Done.

No idea if one should be closer at 10 Gbits/sec.

@david
Copy link
Collaborator

david commented Jan 28, 2025

ethtool says 10GB/s

oot@lucy:~
$ ethtool net03
Settings for net03:
	Supported ports: [ FIBRE ]
	Supported link modes:   1000baseT/Full
	                        25000baseCR/Full
	                        25000baseSR/Full
	                        1000baseX/Full
	                        10000baseCR/Full
	                        10000baseSR/Full
	                        10000baseLR/Full
	Supported pause frame use: Symmetric
	Supports auto-negotiation: Yes
	Supported FEC modes: None
	Advertised link modes:  1000baseX/Full
	                        10000baseSR/Full
	Advertised pause frame use: No
	Advertised auto-negotiation: Yes
	Advertised FEC modes: None
	Speed: 10000Mb/s
	Duplex: Full
	Auto-negotiation: off
	Port: FIBRE
	PHYAD: 0
	Transceiver: internal
	Supports Wake-on: d
	Wake-on: d
        Current message level: 0x00000007 (7)
                               drv probe link
	Link detected: yes

Sign in to join this conversation on GitHub.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@david @pmenzel