[switch port issue] ceph10 enp65s0f1 at 100Mb/s instead of 10000Mb/s

[dmoessne]

Checking interface speeds we found on ceph10 enp65s0f1 was running at 100Mb/s instead of 10000Mb/s:

[core@ceph10 ~]$ ethtool enp65s0f1
Settings for enp65s0f1:
	Supported ports: [ TP ]
	Supported link modes:   100baseT/Full
	                        1000baseT/Full
	                        10000baseT/Full
	Supported pause frame use: Symmetric
	Supports auto-negotiation: Yes
	Supported FEC modes: Not reported
	Advertised link modes:  100baseT/Full
	                        1000baseT/Full
	                        10000baseT/Full
	Advertised pause frame use: Symmetric
	Advertised auto-negotiation: Yes
	Advertised FEC modes: Not reported
	Speed: 100Mb/s
	Duplex: Full
	Auto-negotiation: on
	Port: Twisted Pair
	PHYAD: 0
	Transceiver: internal
	MDI-X: Unknown
netlink error: Operation not permitted
        Current message level: 0x00000007 (7)
                               drv probe link
	Link detected: yes
[core@ceph10 ~]$ 
[core@ceph10 ~]$ ip link show enp65s0f1
5: enp65s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master coe-bridge state UP mode DEFAULT group default qlen 1000
    link/ether a0:36:9f:07:04:c1 brd ff:ff:ff:ff:ff:ff
[core@ceph10 ~]$ ip addr show enp65s0f1
5: enp65s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master coe-bridge state UP group default qlen 1000
    link/ether a0:36:9f:07:04:c1 brd ff:ff:ff:ff:ff:ff
[core@ceph10 ~]$ 

[dmoessne]

Troubleshooting the issue we found that moving the cable to a different port on the switch solved the issue. Resetting (shot/no shut) the port Et17 as well as testing w/ another cable and server did not work and port did never come up. Hence decided to mark port as broken, keep it shut and move cable to port Et25:

arista-rj45#show int status |egrep '17|25'
Et17       broken                            disabled     1        auto   auto   10GBASE-T                      
Et25       ceph12 - secondary                connected    trunk    a-full a-10G  10GBASE-T                      
arista-rj45#

[core@ceph10 ~]$ ethtool enp65s0f1
Settings for enp65s0f1:
	Supported ports: [ TP ]
	Supported link modes:   100baseT/Full
	                        1000baseT/Full
	                        10000baseT/Full
	Supported pause frame use: Symmetric
	Supports auto-negotiation: Yes
	Supported FEC modes: Not reported
	Advertised link modes:  100baseT/Full
	                        1000baseT/Full
	                        10000baseT/Full
	Advertised pause frame use: Symmetric
	Advertised auto-negotiation: Yes
	Advertised FEC modes: Not reported
	Speed: 10000Mb/s
	Duplex: Full
	Auto-negotiation: on
	Port: Twisted Pair
	PHYAD: 0
	Transceiver: internal
	MDI-X: Unknown
netlink error: Operation not permitted
        Current message level: 0x00000007 (7)
                               drv probe link
	Link detected: yes
[core@ceph10 ~]$