[BPI-R4] SFP+ port - break downs in performance

Hi, running openwrt snapshot latest from iirc yesterday. When i run my workstation on the lan1 port, all is fine. When i switch that to the sfp+ port (sfp-rj45 converter), i get wierd results and i am not sure if this is a problem with the sfp±rj45-adapter or something with openwrt.

It should be a consistent state, not with such a drops. It gets even worse when it comes to upload: Anyone an idea what could cause that? I use an active FAN so the temperature shouldnt be that hot.

Only sfp-port has 100mbit or the others too? Bpi-r4?

How does ethtool look like on this interface and related dmesg? Which module do you use here exactly? Maybe the eeprom is wrong (fallback to 100mbit maybe).

So please dump the i2c devices too

i2cdetect -l

Then

i2cdetect -y <bus-nr-found>

Then

i2cdump -y <bus-nr-found> 0x<addr>

its not 100mbit its 1gbit from the measurement. the sfp adapter has 10gbit. but i can exclude a problem with my isp, because when i use the lan1 port all is fine.

root@OpenWrt:~# ethtool eth1
Settings for eth1:
	Supported ports: [ FIBRE ]
	Supported link modes:   10000baseSR/Full 
	Supported pause frame use: Symmetric Receive-only
	Supports auto-negotiation: Yes
	Supported FEC modes: Not reported
	Advertised link modes:  10000baseSR/Full 
	Advertised pause frame use: Symmetric Receive-only
	Advertised auto-negotiation: Yes
	Advertised FEC modes: Not reported
	Speed: 10000Mb/s
	Duplex: Full
	Port: FIBRE
	PHYAD: 0
	Transceiver: internal
	Auto-negotiation: on
	Current message level: 0x000000ff (255)
			       drv probe link timer ifdown ifup rx_err tx_err
	Link detected: yes

root@OpenWrt:~# i2cdetect -l
i2c-0	i2c       	i2c-mt65xx                      	I2C adapter
i2c-1	i2c       	i2c-mt65xx                      	I2C adapter
i2c-2	i2c       	i2c-1-mux (chan_id 0)           	I2C adapter
i2c-3	i2c       	i2c-1-mux (chan_id 1)           	I2C adapter
i2c-4	i2c       	i2c-1-mux (chan_id 2)           	I2C adapter
i2c-5	i2c       	i2c-1-mux (chan_id 3)           	I2C adapter

i am not sure which one related to the sfp port (eth1)

oh interesting found in dmesg:

[84122.462626] mtk_soc_eth 15100000.ethernet eth1: Link is Up - 10Gbps/Full - flow control off
[84122.471015] br-lan: port 1(eth1) entered blocking state
[84122.476234] br-lan: port 1(eth1) entered forwarding state
[84193.955665] mtk_soc_eth 15100000.ethernet eth1: Link is Down
[84193.961644] br-lan: port 1(eth1) entered disabled state
[84197.627300] mtk_soc_eth 15100000.ethernet eth1: Link is Up - 10Gbps/Full - flow control off
[84197.635693] br-lan: port 1(eth1) entered blocking state
[84197.640918] br-lan: port 1(eth1) entered forwarding state
[84365.282383] mtk_soc_eth 15100000.ethernet eth1: Link is Down
[84365.288425] br-lan: port 1(eth1) entered disabled state
[84368.536855] mtk_soc_eth 15100000.ethernet eth1: Link is Up - 10Gbps/Full - flow control off
[84368.545245] br-lan: port 1(eth1) entered blocking state
[84368.550471] br-lan: port 1(eth1) entered forwarding state
[84707.869969] mtk_soc_eth 15100000.ethernet eth1: Link is Down
[84707.876022] br-lan: port 1(eth1) entered disabled state
[84711.645169] mtk_soc_eth 15100000.ethernet eth1: Link is Up - 10Gbps/Full - flow control off
[84711.653560] br-lan: port 1(eth1) entered blocking state
[84711.658778] br-lan: port 1(eth1) entered forwarding state
[84781.038716] mtk_soc_eth 15100000.ethernet eth1: Link is Down
[84781.044688] br-lan: port 1(eth1) entered disabled state
[84784.604767] mtk_soc_eth 15100000.ethernet eth1: Link is Up - 10Gbps/Full - flow control off
[84784.613157] br-lan: port 1(eth1) entered blocking state
[84784.618377] br-lan: port 1(eth1) entered forwarding state
[84965.650090] mtk_soc_eth 15100000.ethernet eth1: Link is Down
[84965.656077] br-lan: port 1(eth1) entered disabled state
[84968.593498] mtk_soc_eth 15100000.ethernet eth1: Link is Up - 10Gbps/Full - flow control off
[84968.601879] br-lan: port 1(eth1) entered blocking state
[84968.607106] br-lan: port 1(eth1) entered forwarding state

logread is also interesting: the first lines show that the workstation used lan3 before, then got plugged in to eth1 and then a lot of errors appear. not sure if its a dhcp problem?

Thu Mar 28 22:50:47 2024 kern.info kernel: [49721.477022] mt7530-mmio 15020000.switch lan3: Link is Down
Thu Mar 28 22:50:47 2024 kern.info kernel: [49721.483023] br-lan: port 4(lan3) entered disabled state
Thu Mar 28 22:50:50 2024 kern.info kernel: [49724.367728] mt7530-mmio 15020000.switch lan3: Link is Up - 1Gbps/Full - flow control rx/tx
Thu Mar 28 22:50:50 2024 kern.info kernel: [49724.376399] br-lan: port 4(lan3) entered blocking state
Thu Mar 28 22:50:50 2024 kern.info kernel: [49724.381625] br-lan: port 4(lan3) entered forwarding state
Thu Mar 28 22:50:50 2024 daemon.notice netifd: Network device 'lan3' link is up
Thu Mar 28 22:50:51 2024 daemon.warn odhcpd[1988]: No default route present, overriding ra_lifetime!
Thu Mar 28 22:50:52 2024 daemon.warn odhcpd[1988]: No default route present, overriding ra_lifetime!
Thu Mar 28 22:52:20 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 22:54:27 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 22:54:36 2024 daemon.notice hostapd: phy0-ap0: AP-STA-DISCONNECTED 54:b7:bd:5f:fd:2a
Thu Mar 28 22:55:51 2024 daemon.notice netifd: wan (2870): udhcpc: sending renew to server 77.109.180.81
Thu Mar 28 22:55:51 2024 daemon.notice netifd: wan (2870): udhcpc: lease of 85.195.252.66 obtained from 77.109.180.81, lease time 4000
Thu Mar 28 22:56:28 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 22:58:01 2024 daemon.warn odhcpd[1988]: No default route present, overriding ra_lifetime!
Thu Mar 28 22:58:18 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:00:08 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:02:00 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:03:50 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:05:39 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:06:24 2024 daemon.warn odhcpd[1988]: No default route present, overriding ra_lifetime!
Thu Mar 28 23:07:31 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:09:28 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:10:42 2024 kern.info kernel: [50917.077366] mt7530-mmio 15020000.switch lan3: Link is Down
Thu Mar 28 23:10:42 2024 kern.info kernel: [50917.083358] br-lan: port 4(lan3) entered disabled state
Thu Mar 28 23:10:42 2024 daemon.notice netifd: Network device 'lan3' link is down
Thu Mar 28 23:11:35 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:13:34 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:15:37 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:16:20 2024 daemon.warn odhcpd[1988]: No default route present, overriding ra_lifetime!
Thu Mar 28 23:17:26 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:19:22 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:21:12 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:21:26 2024 daemon.warn odhcpd[1988]: No default route present, overriding ra_lifetime!
Thu Mar 28 23:23:02 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:24:57 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:25:45 2024 daemon.warn odhcpd[1988]: No default route present, overriding ra_lifetime!
Thu Mar 28 23:27:04 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:29:10 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:29:11 2024 daemon.notice netifd: wan (2870): udhcpc: sending renew to server 77.109.180.81
Thu Mar 28 23:29:11 2024 daemon.notice netifd: wan (2870): udhcpc: lease of 85.195.252.66 obtained from 77.109.180.81, lease time 4000
Thu Mar 28 23:29:43 2024 daemon.warn odhcpd[1988]: No default route present, overriding ra_lifetime!
Thu Mar 28 23:31:10 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:33:15 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:35:16 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:37:11 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:37:48 2024 daemon.warn odhcpd[1988]: No default route present, overriding ra_lifetime!
Thu Mar 28 23:39:18 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:41:25 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:41:58 2024 daemon.warn odhcpd[1988]: No default route present, overriding ra_lifetime!
Thu Mar 28 23:43:28 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:45:28 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:46:34 2024 daemon.warn odhcpd[1988]: No default route present, overriding ra_lifetime!
Thu Mar 28 23:47:39 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:49:33 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:51:22 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:53:24 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:54:24 2024 daemon.warn odhcpd[1988]: No default route present, overriding ra_lifetime!
Thu Mar 28 23:55:14 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:57:15 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Thu Mar 28 23:58:15 2024 daemon.warn odhcpd[1988]: No default route present, overriding ra_lifetime!
Thu Mar 28 23:59:10 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:01:03 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:02:31 2024 daemon.notice netifd: wan (2870): udhcpc: sending renew to server 77.109.180.81
Fri Mar 29 00:02:31 2024 daemon.notice netifd: wan (2870): udhcpc: lease of 85.195.252.66 obtained from 77.109.180.81, lease time 4000
Fri Mar 29 00:03:08 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:05:07 2024 daemon.warn odhcpd[1988]: No default route present, overriding ra_lifetime!
Fri Mar 29 00:05:07 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:06:57 2024 daemon.notice hostapd: phy0-ap0: AP-STA-DISCONNECTED c0:ee:fb:e2:ec:08
Fri Mar 29 00:07:10 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:09:12 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:09:37 2024 daemon.warn odhcpd[1988]: No default route present, overriding ra_lifetime!
Fri Mar 29 00:11:02 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:13:08 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:14:25 2024 daemon.warn odhcpd[1988]: No default route present, overriding ra_lifetime!
Fri Mar 29 00:15:09 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:17:10 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:19:03 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:20:54 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:22:48 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:24:04 2024 daemon.warn odhcpd[1988]: No default route present, overriding ra_lifetime!
Fri Mar 29 00:24:59 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:26:52 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:27:01 2024 daemon.info hostapd: phy0-ap0: STA c0:ee:fb:e2:ec:08 IEEE 802.11: authenticated
Fri Mar 29 00:27:01 2024 daemon.info hostapd: phy0-ap0: STA c0:ee:fb:e2:ec:08 IEEE 802.11: associated (aid 2)
Fri Mar 29 00:27:01 2024 daemon.notice hostapd: phy0-ap0: AP-STA-CONNECTED c0:ee:fb:e2:ec:08 auth_alg=open
Fri Mar 29 00:27:01 2024 daemon.info hostapd: phy0-ap0: STA c0:ee:fb:e2:ec:08 WPA: pairwise key handshake completed (RSN)
Fri Mar 29 00:27:01 2024 daemon.notice hostapd: phy0-ap0: EAPOL-4WAY-HS-COMPLETED c0:ee:fb:e2:ec:08
Fri Mar 29 00:27:02 2024 daemon.warn odhcpd[1988]: No default route present, overriding ra_lifetime!
Fri Mar 29 00:28:16 2024 daemon.notice hostapd: phy0-ap0: AP-STA-DISCONNECTED c0:ee:fb:e2:ec:08
Fri Mar 29 00:28:49 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:29:01 2024 daemon.warn odhcpd[1988]: No default route present, overriding ra_lifetime!
Fri Mar 29 00:30:56 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:32:22 2024 daemon.warn odhcpd[1988]: No default route present, overriding ra_lifetime!
Fri Mar 29 00:32:52 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:35:00 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:35:51 2024 daemon.notice netifd: wan (2870): udhcpc: sending renew to server 77.109.180.81
Fri Mar 29 00:35:51 2024 daemon.notice netifd: wan (2870): udhcpc: lease of 85.195.252.66 obtained from 77.109.180.81, lease time 4000
Fri Mar 29 00:37:06 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:37:29 2024 daemon.warn odhcpd[1988]: No default route present, overriding ra_lifetime!
Fri Mar 29 00:39:11 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:41:00 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:41:31 2024 daemon.warn odhcpd[1988]: No default route present, overriding ra_lifetime!
Fri Mar 29 00:42:54 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:44:54 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:46:49 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:48:44 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)
Fri Mar 29 00:49:57 2024 daemon.info hostapd: phy0-ap0: STA c0:ee:fb:e2:ec:08 IEEE 802.11: authenticated
Fri Mar 29 00:49:57 2024 daemon.info hostapd: phy0-ap0: STA c0:ee:fb:e2:ec:08 IEEE 802.11: associated (aid 2)
Fri Mar 29 00:49:57 2024 daemon.notice hostapd: phy0-ap0: AP-STA-CONNECTED c0:ee:fb:e2:ec:08 auth_alg=open
Fri Mar 29 00:49:57 2024 daemon.info hostapd: phy0-ap0: STA c0:ee:fb:e2:ec:08 WPA: pairwise key handshake completed (RSN)
Fri Mar 29 00:49:57 2024 daemon.notice hostapd: phy0-ap0: EAPOL-4WAY-HS-COMPLETED c0:ee:fb:e2:ec:08
Fri Mar 29 00:49:58 2024 daemon.warn odhcpd[1988]: No default route present, overriding ra_lifetime!
Fri Mar 29 00:50:52 2024 daemon.err odhcp6c[2866]: Failed to send SOLICIT message to ff02::1:2 (Address not available)

i dont use dnsmasq but unbound because the r4 is my own resolver with adblock.

All errors i see in below log are iv6 related,so try to disable ipv6 for now. Ipv4 got dhcp response.

Interesting is the above log where interface eth1 goes up and down. Maybe it gets solved by disabling ipv6,but normally it should not go down if ipv6 is not available.

You can also try disabling odhcp6c maybe it puts eth1 down if sending to multicast does not work

For i2c,you see the i2c-mux for i2c 2-5…sfp slots are channel 1+2 (2nd and 3rd).

disabled ipv6, all is good now 0o

maybe some sort of mis-configuration that leads to an error that leads to an overflow that leads to a crash in some part of the driver code…? xD

I guess it is the service configured to drop interface on error…so interface flap is fixed too? You can try enabling ipv6 again and just disabling the service

I made a mistake before, the first i2cdump should be i2cdetect

Thanks… fixed… :stuck_out_tongue: (fillchars)