[BPI-R4] Help : LAN SFP+ is disconnecting WAN XGSPON

Banana Pi Router design BPI-R4(MT7988)
1

:wave: Hi everyone !

I am a happy owner of a BPI-R4 bought in august. Since the beginning it work like a charm with a xgspon to bypass ISP router.

XGSPON ONU Stick SFP+ (MaxLinear PRX126)

Now I’ve bought a SFP+ module on the same supplier but i struggle to make it work.

SFP-10G-TS RJ45 (30m)

In fact, when i insert the module, it seems make the xgspon disconnect:

At startup (with only XGSPON) no problem:

[   19.624951] mtk_soc_eth 15100000.ethernet sfp-wan: Link is Up - 10Gbps/Full - flow control off
[   20.642672] mtk_soc_eth 15100000.ethernet sfp-wan: Link is Down
[   22.744946] mtk_soc_eth 15100000.ethernet sfp-wan: Link is Up - 10Gbps/Full - flow control off

WAN is working flawlessly, but when inserting the SFP+ module:

[  116.944015] sfp sfp2: module FiberMall        SFP-10G-TS       rev A    sn MT244950001      dc 241206  
[  116.983977] hwmon hwmon6: temp1_input not attached to any thermal zone
[  146.473745] sfp sfp1: module removed
[  146.477346] mtk_soc_eth 15100000.ethernet sfp-wan: Link is Down
[  146.803747] sfp sfp1: module FiberMall        XGSPON-ONU-STICK rev V1.0 sn MT242960002      dc 240725  
[  146.843546] hwmon hwmon2: temp1_input not attached to any thermal zone
[  146.914954] mtk_soc_eth 15100000.ethernet sfp-wan: Link is Up - 10Gbps/Full - flow control off
[  146.935483] mtk_soc_eth 15100000.ethernet sfp-lan: Link is Up - 10Gbps/Full - flow control off
[  146.945680] br-lan: port 3(sfp-lan) entered blocking state
[  146.951182] br-lan: port 3(sfp-lan) entered forwarding state
[  147.004465] sfp sfp1: module removed
[  147.008065] mtk_soc_eth 15100000.ethernet sfp-wan: Link is Down
[  147.313100] sfp sfp1: module removed
[  147.633510] sfp sfp1: module FiberMall        XGSPON-ONU-STICK rev V1.0 sn MT242960002      dc 240725  
[  147.683499] hwmon hwmon2: temp1_input not attached to any thermal zone
[  147.744889] mtk_soc_eth 15100000.ethernet sfp-wan: Link is Up - 10Gbps/Full - flow control off
[  148.947507] sfp sfp1: module removed
[  148.951125] mtk_soc_eth 15100000.ethernet sfp-wan: Link is Down
[  149.273478] sfp sfp1: module FiberMall        XGSPON-ONU-STICK rev V1.0 sn MT242960002      dc 240725  
[  149.313524] hwmon hwmon2: temp1_input not attached to any thermal zone
[  149.374869] mtk_soc_eth 15100000.ethernet sfp-wan: Link is Up - 10Gbps/Full - flow control off
[  150.982676] sfp sfp1: module removed
[  150.986303] mtk_soc_eth 15100000.ethernet sfp-wan: Link is Down
[  151.323481] sfp sfp1: module FiberMall        XGSPON-ONU-STICK rev V1.0 sn MT242960002      dc 240725  
[  151.363534] hwmon hwmon2: temp1_input not attached to any thermal zone
[  151.424868] mtk_soc_eth 15100000.ethernet sfp-wan: Link is Up - 10Gbps/Full - flow control off
[  155.163961] sfp sfp1: module removed
[  155.167580] mtk_soc_eth 15100000.ethernet sfp-wan: Link is Down
[  155.493434] sfp sfp1: module FiberMall        XGSPON-ONU-STICK rev V1.0 sn MT242960002      dc 240725  
[  155.533470] hwmon hwmon2: temp1_input not attached to any thermal zone
[  155.594868] mtk_soc_eth 15100000.ethernet sfp-wan: Link is Up - 10Gbps/Full - flow control off
[  158.004217] sfp sfp1: module removed
[  158.007836] mtk_soc_eth 15100000.ethernet sfp-wan: Link is Down
[  158.333407] sfp sfp1: module FiberMall        XGSPON-ONU-STICK rev V1.0 sn MT242960002      dc 240725  
[  158.373503] hwmon hwmon2: temp1_input not attached to any thermal zone
[  158.434804] mtk_soc_eth 15100000.ethernet sfp-wan: Link is Up - 10Gbps/Full - flow control off
[  158.657628] sfp sfp1: module removed
[  158.661276] mtk_soc_eth 15100000.ethernet sfp-wan: Link is Down
[  158.993418] sfp sfp1: module FiberMall        XGSPON-ONU-STICK rev V1.0 sn MT242960002      dc 240725  
[  159.043949] hwmon hwmon2: temp1_input not attached to any thermal zone
[  159.104808] mtk_soc_eth 15100000.ethernet sfp-wan: Link is Up - 10Gbps/Full - flow control off
[  160.014231] sfp sfp1: module removed
[  160.017829] mtk_soc_eth 15100000.ethernet sfp-wan: Link is Down
[  160.343401] sfp sfp1: module FiberMall        XGSPON-ONU-STICK rev V1.0 sn MT242960002      dc 240725  
[  160.383450] hwmon hwmon2: temp1_input not attached to any thermal zone
[  160.444791] mtk_soc_eth 15100000.ethernet sfp-wan: Link is Up - 10Gbps/Full - flow control off
[  162.554773] sfp sfp1: module removed
[  162.558374] mtk_soc_eth 15100000.ethernet sfp-wan: Link is Down
[  162.883365] sfp sfp1: module FiberMall        XGSPON-ONU-STICK rev V1.0 sn MT242960002      dc 240725  
[  162.893340] sfp sfp1: module removed
[  163.077260] sfp sfp1: module removed
[  163.393380] sfp sfp1: module FiberMall        XGSPON-ONU-STICK rev V1.0 sn MT242960002      dc 240725  
[  163.433403] hwmon hwmon2: temp1_input not attached to any thermal zone
[  163.504763] mtk_soc_eth 15100000.ethernet sfp-wan: Link is Up - 10Gbps/Full - flow control off
[  164.658419] sfp sfp1: module removed
[  164.662019] mtk_soc_eth 15100000.ethernet sfp-wan: Link is Down
[  164.694722] sfp sfp1: module removed
[  165.013357] sfp sfp1: module FiberMall        XGSPON-ONU-STICK rev V1.0 sn MT242960002      dc 240725  
[  165.053386] hwmon hwmon2: temp1_input not attached to any thermal zone
[  165.124780] mtk_soc_eth 15100000.ethernet sfp-wan: Link is Up - 10Gbps/Full - flow control off
[  169.777516] br-lan: port 3(sfp-lan) entered disabled state
[  171.210481] sfp sfp2: module transmit fault indicated
[  171.215748] sfp sfp2: module removed

:warning: I’m running the official OpenWrt SNAPSHOT r28675-8e78bc39a3 with his WiFi7 card (SW4 is enabled) and power with USB-C PD with a 65w adapter

Does anybody know where i can start my research, is it possible that the module is not compatible ? the two sfp leds on the board are solid green on both

:pray: Thanks for your help

2

Just a guess: those 10G Ethernet SFP+ are getting very hot (> 70°C), perhaps it is a temperature problem and the heat from this new module propagates somehow over to the XPON?

Edit: There are some more expensive modules (mostly the 80m and 100m variants) which don’t get that hot, there is a thread in 10Gb SFP+ RJ45 100m | ServeTheHome Forums

3

Thanks for you suggestion, even with a cold temperature (ambiant) the error is still occured

4

Ok thanks… from you log I see it takes approx 30 seconds when you plug it in and when it shuts down the XPON. So with cooling it does not differ? It is still 30 sec?

You could also try to read the sfp module with ethtool -m when you ssh in to bpi r4. ( ethtool -m sfp-wan ) - you first need to install the packet ethtool-full

There you could also see temperatures (if the module reports it) - eg. you could see the usual temperature of the XPON and when you insert the ethernet one, observe it the internal temp changes?

6

Ok so after some testing I found that the problem occurs, not after plugging the SFP, but ONLY AFTER I plug a Ethernet cable in it, no matters the temps. overwise there is no disconnect. Thanks to your suggestion here’s the thermals that I have with ethtools:

At plug: SFP-WAN 64.25ºC SFP-LAN 23.10ºC

After several minutes: SFP-WAN 65.25ºC SFP-LAN 45.50ºC