[BPI-R4] Low speed on WAN through SFP+ 10g port (but not with my Mac mini)

Banana Pi Router design BPI-R4(MT7988)
1

Hi,

3 days ago I upgraded my ISP connection to 10g (router zyxel AX7501-B0, 1 10g lan, 4 1g lan)

I tried with my max mini (with 10g port) some speediest (max directly connected to ISP router) and with some server (near to my home) I get 7.5-8.5 download/4.5-6.5 upload (my 10g Internet connection is symmetric).

Next step was to connect my r4 (with openwrt 24.10.0-rc5, 2 SFP+ ports) via sfp+ port to 10g LAN port of my ISP router, using 10Gtek 10BaseT transceiver.

So, I started to verify eth2 device with ethtool:

Supported ports: [  ]
	Supported link modes:   100baseT/Full
	                        1000baseT/Full
	                        10000baseT/Full
	                        1000baseKX/Full
	                        10000baseKX4/Full
	                        10000baseKR/Full
	                        2500baseT/Full
	                        5000baseT/Full
	Supported pause frame use: Symmetric Receive-only
	Supports auto-negotiation: Yes
	Supported FEC modes: Not reported
	Advertised link modes:  100baseT/Full
	                        1000baseT/Full
	                        10000baseT/Full
	                        1000baseKX/Full
	                        10000baseKX4/Full
	                        10000baseKR/Full
	                        2500baseT/Full
	                        5000baseT/Full
	Advertised pause frame use: Symmetric Receive-only
	Advertised auto-negotiation: Yes
	Advertised FEC modes: Not reported
	Link partner advertised link modes:  100baseT/Half 100baseT/Full
	                                     1000baseT/Half 1000baseT/Full
	                                     10000baseT/Full
	                                     2500baseT/Full
	                                     5000baseT/Full
	Link partner advertised pause frame use: Symmetric Receive-only
	Link partner advertised auto-negotiation: Yes
	Link partner advertised FEC modes: Not reported
	Speed: 10000Mb/s
	Duplex: Full
	Auto-negotiation: on
	Port: Twisted Pair
	PHYAD: 11
	Transceiver: external
	MDI-X: Unknown
        Current message level: 0x000000ff (255)
                               drv probe link timer ifdown ifup rx_err tx_err
	Link detected: yes

Then I configured wan interface with eth2 device (no br-wan) and I tried some speedtests with same above servers but in this case I get very low speed: for example

speedtest --test-server speedtestto1.telecomitalia.it.prod.hosts.ooklaserver.net:8080
SpeedTest++ version 1.20.3
Speedtest.net command line interface
Info: https://github.com/oskarirauta/speedtestcpp
Author: Francesco Laurita <[email protected]>
Co-authored-by: Oskari Rauta <[email protected]>

Server #19:  speedtestto1.telecomitalia.it.prod.hosts.ooklaserver.net:8080 by  : 0 ms
Ping: 0 ms.
Jitter: 0 ms.

server selected profile detected: profile selected from server configuration

Download: 2327.90 Mbit/s                                    
Upload: 1070.73 Mbit/s

Can you please direct me to the checks I need to do to get the same speed (approximately) as the Mac?

Thanks in advance

2

Are you running speedtest.net on the mac through both routers or on the r4, which OS is on the R4? The R4 on openwrt 24.10 will do 10gbit NAT with hardware offloading but nowhere that as end point.

If speedtest.net is unning on the Mac, check if hardware offloading is on.

3

My first test is with Mac mini directly connected (I have a 10G ethernet port on the this Mac mini) to my ISP router: I get 7.5/8.5 Gbps download speed.

My second test is made connecting R4 (eth2 port) to ISP router and running speedtest on the R4: I get 2.3 Gbps (with hardware offloading): at this moment I can’t run a test with Mac mini → R4-> ISP router because I am waiting for new 10G switch (in few days).

So, why if I use R4 as end point I can’t reach that speed?

Thanks

4

Hardware offloading is active when it acts as router, not endpoint.

So what you see is expected. 10G with the R4 as endpoint? Not right now, maybe not ever (it’s among other a question of drivers. But I am also not sure what benefit that would give?!?

5

Now I understand: I don’t want to use R4 as endpoint, it was just for a test while waiting to have my new switch.

So, I will wait a few days and repeat the test with Mac mini connected to R4.

Many thanks buz.

6

just to correct you. mtk has released rss for the 6.6 kernel and it applies cleanly on openwrt mainline. with a few other additional optimisations, my current build can download 8+Gbps as endpoint.

7

Thanks, I missed the RSS release!

Any chance we will see this in MAIN any time soon (or even in 24.10 it goes final?).

8

imho it’s straight forward to apply those patches.

there’s quite a few things that mtk released a while back but not incorporated yet on openwrt mainline much less 24.10. so…

9

Great, can you share your build?

10

Rss release was today…after we ruled out an issue in iperf on my test environment. After searching long time in driver code :stuck_out_tongue:

Afaik daniel is testing rss patch in openwrt and it depends on some settings (e.g. setting smp-affinity for the rss irqs, disable rps, and maybe need additional patch to get 6 irqs for mt7988 i get…openwrt is only 5 without mtk-feed). Give him some time for testing :slight_smile: we are doing this all in freetime…

3 Likes
11

Totally aware of that and thanks a ton for that! No rush whatsoever, 24.10 does all I want it to do it day to day already.

It’s more that RSS would get rid of questions exactly like the one in this thread…