[BPI-R4-PRO] Mainline OpenWRT

The patches for 10G phys were merged yesterday and now you can usr the wan-phy overlay to enable it.

1 Like
# 1. Remove the lan6 port from the local LAN bridge configuration
uci del_list network.lan_dev.ports='lan6'

# 2. Assign the physical lan6 port to the IPv4 WAN interface
uci set network.wan.device='lan6'

# 3. Assign the physical lan6 port to the IPv6 WAN interface
uci set network.wan6.device='lan6'

# 4. Commit and save the network configuration changes to flash memory
uci commit network

# 5. Reload the network service to apply the changes immediately
service network reload

I use AI for help it. But i think that it include in openwrt wiki.

1 Like

I do it:

# 1. Remove the lan6 port from the local LAN bridge configuration
uci del_list network.lan_dev.ports='lan6'

# 2. Assign the physical lan6 port to the IPv4 WAN interface
uci set network.wan.device='lan6'

# 3. Assign the physical lan6 port to the IPv6 WAN interface
uci set network.wan6.device='lan6'

# 4. Commit and save the network configuration changes to flash memory
uci commit network

# 5. Reload the network service to apply the changes immediately
service network reload

And use the board for set settings in LUCI, ssh, ping. It has 1G link from some other router.

Now i use WAN-sfp port with SFP to RG-45 1.25G reconnector. And it work good.

Now i use iperf3. Link is 1G. Wan-sfp with sft to rg45 reconnector. BPI r4 pro 4r is not SERVER.

root@BPI:~# iperf3 -c 192.168.31.1
Connecting to host 192.168.31.1, port 5201
[  5] local 192.168.31.112 port 35210 connected to 192.168.31.1 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   114 MBytes   952 Mbits/sec    0    602 KBytes
[  5]   1.00-2.00   sec   112 MBytes   943 Mbits/sec    0    635 KBytes
[  5]   2.00-3.00   sec   112 MBytes   943 Mbits/sec    0    710 KBytes
[  5]   3.00-4.00   sec   112 MBytes   943 Mbits/sec    0    918 KBytes
[  5]   4.00-5.00   sec   111 MBytes   932 Mbits/sec    0    963 KBytes
[  5]   5.00-6.00   sec   112 MBytes   942 Mbits/sec    0    963 KBytes
[  5]   6.00-7.00   sec   112 MBytes   935 Mbits/sec    0    963 KBytes
[  5]   7.00-8.00   sec   113 MBytes   945 Mbits/sec    0    963 KBytes
[  5]   8.00-9.00   sec   111 MBytes   929 Mbits/sec    0   1.01 MBytes
[  5]   9.00-10.00  sec   112 MBytes   940 Mbits/sec    0   1.01 MBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  1.09 GBytes   940 Mbits/sec    0            sender
[  5]   0.00-10.01  sec  1.09 GBytes   938 Mbits/sec                  receiver

iperf Done.

REVERSE (bpi r4 pro 4e like server). Link is 1G. Wan-sfp:

root@AX6000:~# iperf3 -c 192.168.31.112
Connecting to host 192.168.31.112, port 5201
[  5] local 192.168.31.1 port 47434 connected to 192.168.31.112 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   114 MBytes   956 Mbits/sec    0    618 KBytes
[  5]   1.00-2.00   sec   112 MBytes   936 Mbits/sec    0    618 KBytes
[  5]   2.00-3.00   sec   112 MBytes   944 Mbits/sec    0    648 KBytes
[  5]   3.00-4.00   sec   111 MBytes   932 Mbits/sec    0    648 KBytes
[  5]   4.00-5.00   sec   112 MBytes   937 Mbits/sec    0    648 KBytes
[  5]   5.00-6.00   sec   108 MBytes   905 Mbits/sec    0    730 KBytes
[  5]   6.00-7.00   sec   112 MBytes   936 Mbits/sec    0    730 KBytes
[  5]   7.00-8.00   sec   112 MBytes   936 Mbits/sec    0    730 KBytes
[  5]   8.00-9.00   sec   112 MBytes   935 Mbits/sec    0    730 KBytes
[  5]   9.00-10.00  sec   112 MBytes   935 Mbits/sec    0    730 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  1.09 GBytes   936 Mbits/sec    0            sender
[  5]   0.00-10.01  sec  1.09 GBytes   933 Mbits/sec                  receiver

iperf Done.
root@BPI:~# iperf3 -s
-----------------------------------------------------------
Server listening on 5201 (test #1)
-----------------------------------------------------------
Accepted connection from 192.168.31.1, port 47422
[  5] local 192.168.31.112 port 5201 connected to 192.168.31.1 port 47434
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec   112 MBytes   934 Mbits/sec
[  5]   1.00-2.00   sec   112 MBytes   936 Mbits/sec
[  5]   2.00-3.00   sec   112 MBytes   936 Mbits/sec
[  5]   3.00-4.00   sec   112 MBytes   936 Mbits/sec
[  5]   4.00-5.00   sec   112 MBytes   935 Mbits/sec
[  5]   5.00-6.00   sec   108 MBytes   904 Mbits/sec
[  5]   6.00-7.00   sec   112 MBytes   936 Mbits/sec
[  5]   7.00-8.00   sec   112 MBytes   936 Mbits/sec
[  5]   8.00-9.00   sec   112 MBytes   936 Mbits/sec
[  5]   9.00-10.00  sec   112 MBytes   936 Mbits/sec
[  5]  10.00-10.01  sec   512 KBytes   835 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-10.01  sec  1.09 GBytes   933 Mbits/sec                  receiver
-----------------------------------------------------------
Server listening on 5201 (test #2)
-----------------------------------------------------------
^Ciperf3: interrupt - the server has terminated by signal Interrupt(2)

You can write to me an other commands for test.

@frank-w Write to me how i can SET wan-phy, please. I’m already confused with the interface names, sorry. I will test iperf3 with phy wan port. UPD1: Found the command:

fw_setenv bootconf_extra "mt7988a-bananapi-bpi-r4-pro-cn13#mt7988a-bananapi-bpi-r4-pro-cn14#mt7988a-bananapi-bpi-r4-pro-4e-wan-phy"
reboot

bpi r4 pro 4e NOT server. WAN-PHY. 1 G link:

root@BPI:~# iperf3 -c 192.168.31.1
Connecting to host 192.168.31.1, port 5201
[  5] local 192.168.31.112 port 53968 connected to 192.168.31.1 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   113 MBytes   945 Mbits/sec    0    916 KBytes
[  5]   1.00-2.00   sec   112 MBytes   944 Mbits/sec    0    916 KBytes
[  5]   2.00-3.00   sec   112 MBytes   940 Mbits/sec  298    489 KBytes
[  5]   3.00-4.00   sec   109 MBytes   915 Mbits/sec  173    392 KBytes
[  5]   4.00-5.00   sec   110 MBytes   926 Mbits/sec    0    522 KBytes
[  5]   5.00-6.00   sec   113 MBytes   947 Mbits/sec  277    332 KBytes
[  5]   6.00-7.00   sec   112 MBytes   940 Mbits/sec  318    310 KBytes
[  5]   7.00-8.00   sec   107 MBytes   897 Mbits/sec  125    454 KBytes
[  5]   8.00-9.00   sec   112 MBytes   935 Mbits/sec  184    291 KBytes
[  5]   9.00-10.00  sec   113 MBytes   945 Mbits/sec    0    469 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  1.09 GBytes   933 Mbits/sec  1375            sender
[  5]   0.00-10.02  sec  1.09 GBytes   930 Mbits/sec                  receiver

iperf Done.

BPI r4 pro 4e is SERVER WAN-PHY. 1 G link:

root@BPI:~# iperf3 -c 192.168.31.1
Connecting to host 192.168.31.1, port 5201
[  5] local 192.168.31.112 port 53968 connected to 192.168.31.1 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   113 MBytes   945 Mbits/sec    0    916 KBytes
[  5]   1.00-2.00   sec   112 MBytes   944 Mbits/sec    0    916 KBytes
[  5]   2.00-3.00   sec   112 MBytes   940 Mbits/sec  298    489 KBytes
[  5]   3.00-4.00   sec   109 MBytes   915 Mbits/sec  173    392 KBytes
[  5]   4.00-5.00   sec   110 MBytes   926 Mbits/sec    0    522 KBytes
[  5]   5.00-6.00   sec   113 MBytes   947 Mbits/sec  277    332 KBytes
[  5]   6.00-7.00   sec   112 MBytes   940 Mbits/sec  318    310 KBytes
[  5]   7.00-8.00   sec   107 MBytes   897 Mbits/sec  125    454 KBytes
[  5]   8.00-9.00   sec   112 MBytes   935 Mbits/sec  184    291 KBytes
[  5]   9.00-10.00  sec   113 MBytes   945 Mbits/sec    0    469 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  1.09 GBytes   933 Mbits/sec  1375            sender
[  5]   0.00-10.02  sec  1.09 GBytes   930 Mbits/sec                  receiver

iperf Done.

BPI r4 pro 4e is SERVER WAN-PHY. 1 G link:

root@BPI:~# iperf3 -s
-----------------------------------------------------------
Server listening on 5201 (test #1)
-----------------------------------------------------------

^Ciperf3: interrupt - the server has terminated by signal Interrupt(2)
root@BPI:~# /etc/init.d/firewall stop
root@BPI:~# iperf3 -s
-----------------------------------------------------------
Server listening on 5201 (test #1)
-----------------------------------------------------------
Accepted connection from 192.168.31.1, port 45952
[  5] local 192.168.31.112 port 5201 connected to 192.168.31.1 port 45954
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec   111 MBytes   932 Mbits/sec
[  5]   1.00-2.00   sec   112 MBytes   936 Mbits/sec
[  5]   2.00-3.00   sec   112 MBytes   937 Mbits/sec
[  5]   3.00-4.00   sec   112 MBytes   935 Mbits/sec
[  5]   4.00-5.00   sec   112 MBytes   936 Mbits/sec
[  5]   5.00-6.00   sec   112 MBytes   935 Mbits/sec
[  5]   6.00-7.00   sec   112 MBytes   936 Mbits/sec
[  5]   7.00-8.00   sec   112 MBytes   936 Mbits/sec
[  5]   8.00-9.00   sec   112 MBytes   935 Mbits/sec
[  5]   9.00-10.00  sec   112 MBytes   936 Mbits/sec
[  5]  10.00-10.00  sec   384 KBytes   994 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-10.00  sec  1.09 GBytes   936 Mbits/sec                  receiver
-----------------------------------------------------------
Server listening on 5201 (test #2)
-----------------------------------------------------------
^Ciperf3: interrupt - the server has terminated by signal Interrupt(2)
1 Like

Mhm,wonder why wan-phy has retransmitts

Btw. You can add -r switch of iperf3 to reverse the direction (leave server as it is) or --bidir for both directions

What do you mean? I can repeat the test.

UPD1:

root@BPI:~# iperf3 -c 192.168.31.1 -R
Connecting to host 192.168.31.1, port 5201
Reverse mode, remote host 192.168.31.1 is sending
[  5] local 192.168.31.112 port 43348 connected to 192.168.31.1 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec   112 MBytes   936 Mbits/sec
[  5]   1.00-2.00   sec   112 MBytes   938 Mbits/sec
[  5]   2.00-3.00   sec   112 MBytes   937 Mbits/sec
[  5]   3.00-4.00   sec   109 MBytes   915 Mbits/sec
[  5]   4.00-5.00   sec   110 MBytes   922 Mbits/sec
[  5]   5.00-6.00   sec   112 MBytes   937 Mbits/sec
[  5]   6.00-7.00   sec   112 MBytes   938 Mbits/sec
[  5]   7.00-8.00   sec   112 MBytes   937 Mbits/sec
[  5]   8.00-9.00   sec   112 MBytes   937 Mbits/sec
[  5]   9.00-10.00  sec   111 MBytes   934 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.03  sec  1.09 GBytes   933 Mbits/sec    0            sender
[  5]   0.00-10.00  sec  1.09 GBytes   933 Mbits/sec                  receiver

iperf Done.
root@BPI:~# iperf3 -c 192.168.31.1 -R
Connecting to host 192.168.31.1, port 5201
Reverse mode, remote host 192.168.31.1 is sending
[  5] local 192.168.31.112 port 52460 connected to 192.168.31.1 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec   112 MBytes   935 Mbits/sec
[  5]   1.00-2.00   sec   111 MBytes   931 Mbits/sec
[  5]   2.00-3.00   sec   112 MBytes   938 Mbits/sec
[  5]   3.00-4.00   sec   112 MBytes   938 Mbits/sec
[  5]   4.00-5.00   sec   112 MBytes   937 Mbits/sec
[  5]   5.00-6.00   sec   111 MBytes   931 Mbits/sec
[  5]   6.00-7.00   sec   111 MBytes   931 Mbits/sec
[  5]   7.00-8.00   sec   112 MBytes   937 Mbits/sec
[  5]   8.00-9.00   sec   112 MBytes   937 Mbits/sec
[  5]   9.00-10.00  sec   112 MBytes   937 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.02  sec  1.09 GBytes   937 Mbits/sec    0            sender
[  5]   0.00-10.00  sec  1.09 GBytes   936 Mbits/sec                  receiver

iperf Done.
root@BPI:~# ethtool eth0 | grep Speed
        Speed: 10000Mb/s
root@BPI:~# iperf3 -c 192.168.31.1 -P 4
Connecting to host 192.168.31.1, port 5201
[  5] local 192.168.31.112 port 60146 connected to 192.168.31.1 port 5201
[  7] local 192.168.31.112 port 60148 connected to 192.168.31.1 port 5201
[  9] local 192.168.31.112 port 60152 connected to 192.168.31.1 port 5201
[ 11] local 192.168.31.112 port 60164 connected to 192.168.31.1 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  29.0 MBytes   243 Mbits/sec    0    337 KBytes
[  7]   0.00-1.00   sec  28.8 MBytes   241 Mbits/sec    0    300 KBytes
[  9]   0.00-1.00   sec  29.0 MBytes   243 Mbits/sec    0    337 KBytes
[ 11]   0.00-1.00   sec  28.5 MBytes   239 Mbits/sec    0    318 KBytes
[SUM]   0.00-1.00   sec   115 MBytes   966 Mbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  27.9 MBytes   234 Mbits/sec    0    362 KBytes
[  7]   1.00-2.00   sec  28.0 MBytes   235 Mbits/sec    0    322 KBytes
[  9]   1.00-2.00   sec  28.0 MBytes   235 Mbits/sec    0    366 KBytes
[ 11]   1.00-2.00   sec  27.9 MBytes   234 Mbits/sec    0    346 KBytes
[SUM]   1.00-2.00   sec   112 MBytes   937 Mbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  27.6 MBytes   232 Mbits/sec    0    362 KBytes
[  7]   2.00-3.00   sec  28.0 MBytes   235 Mbits/sec    0    322 KBytes
[  9]   2.00-3.00   sec  28.2 MBytes   237 Mbits/sec    0    366 KBytes
[ 11]   2.00-3.00   sec  28.0 MBytes   235 Mbits/sec    0    346 KBytes
[SUM]   2.00-3.00   sec   112 MBytes   938 Mbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  28.0 MBytes   235 Mbits/sec    0    395 KBytes
[  7]   3.00-4.00   sec  27.4 MBytes   230 Mbits/sec    0    338 KBytes
[  9]   3.00-4.00   sec  27.9 MBytes   234 Mbits/sec    0    397 KBytes
[ 11]   3.00-4.00   sec  27.9 MBytes   234 Mbits/sec    0    378 KBytes
[SUM]   3.00-4.00   sec   111 MBytes   932 Mbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  28.0 MBytes   235 Mbits/sec    0    395 KBytes
[  7]   4.00-5.00   sec  28.4 MBytes   238 Mbits/sec    0    338 KBytes
[  9]   4.00-5.00   sec  27.9 MBytes   234 Mbits/sec    0    397 KBytes
[ 11]   4.00-5.00   sec  28.2 MBytes   237 Mbits/sec    0    378 KBytes
[SUM]   4.00-5.00   sec   112 MBytes   944 Mbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   5.00-6.00   sec  28.2 MBytes   237 Mbits/sec    0    426 KBytes
[  7]   5.00-6.00   sec  27.6 MBytes   232 Mbits/sec    0    383 KBytes
[  9]   5.00-6.00   sec  28.2 MBytes   237 Mbits/sec    0    452 KBytes
[ 11]   5.00-6.00   sec  27.9 MBytes   234 Mbits/sec    0    404 KBytes
[SUM]   5.00-6.00   sec   112 MBytes   940 Mbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   6.00-7.00   sec  27.8 MBytes   233 Mbits/sec    0    426 KBytes
[  7]   6.00-7.00   sec  28.2 MBytes   237 Mbits/sec    0    383 KBytes
[  9]   6.00-7.00   sec  27.9 MBytes   234 Mbits/sec    0    452 KBytes
[ 11]   6.00-7.00   sec  27.9 MBytes   234 Mbits/sec    0    404 KBytes
[SUM]   6.00-7.00   sec   112 MBytes   937 Mbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   7.00-8.00   sec  28.4 MBytes   238 Mbits/sec    0    426 KBytes
[  7]   7.00-8.00   sec  27.9 MBytes   234 Mbits/sec    0    383 KBytes
[  9]   7.00-8.00   sec  28.4 MBytes   238 Mbits/sec    0    452 KBytes
[ 11]   7.00-8.00   sec  28.2 MBytes   237 Mbits/sec    0    404 KBytes
[SUM]   7.00-8.00   sec   113 MBytes   947 Mbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   8.00-9.00   sec  28.4 MBytes   238 Mbits/sec   29    417 KBytes
[  7]   8.00-9.00   sec  28.5 MBytes   239 Mbits/sec    0    576 KBytes
[  9]   8.00-9.00   sec  27.4 MBytes   230 Mbits/sec   90    366 KBytes
[ 11]   8.00-9.00   sec  27.8 MBytes   233 Mbits/sec   16    337 KBytes
[SUM]   8.00-9.00   sec   112 MBytes   940 Mbits/sec  135
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   9.00-10.00  sec  28.0 MBytes   235 Mbits/sec    0    417 KBytes
[  7]   9.00-10.00  sec  27.6 MBytes   232 Mbits/sec    0    576 KBytes
[  9]   9.00-10.00  sec  28.2 MBytes   237 Mbits/sec    0    366 KBytes
[ 11]   9.00-10.00  sec  28.2 MBytes   237 Mbits/sec    0    337 KBytes
[SUM]   9.00-10.00  sec   112 MBytes   940 Mbits/sec    0
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   281 MBytes   236 Mbits/sec   29            sender
[  5]   0.00-10.02  sec   280 MBytes   234 Mbits/sec                  receiver
[  7]   0.00-10.00  sec   280 MBytes   235 Mbits/sec    0            sender
[  7]   0.00-10.02  sec   279 MBytes   234 Mbits/sec                  receiver
[  9]   0.00-10.00  sec   281 MBytes   236 Mbits/sec   90            sender
[  9]   0.00-10.02  sec   280 MBytes   235 Mbits/sec                  receiver
[ 11]   0.00-10.00  sec   280 MBytes   235 Mbits/sec   16            sender
[ 11]   0.00-10.02  sec   279 MBytes   234 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec  1.10 GBytes   942 Mbits/sec  135             sender
[SUM]   0.00-10.02  sec  1.09 GBytes   937 Mbits/sec                  receiver

iperf Done.
root@BPI:~# ip -s link show dev eth0
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1504 qdisc mq state UP mode DEFAULT group default qlen 1000
    link/ether de:cc:8a:ff:a0:36 brd ff:ff:ff:ff:ff:ff
    RX:  bytes packets errors dropped  missed   mcast
             0       0      0       0       0       0
    TX:  bytes packets errors dropped carrier collsns
          1712      16      0       0       0       0
root@BPI:~#

iperf3 -c 192.168.31.1 -P 8

root@BPI:~# iperf3 -c 192.168.31.1 -P 8
Connecting to host 192.168.31.1, port 5201
[  5] local 192.168.31.112 port 33696 connected to 192.168.31.1 port 5201
[  7] local 192.168.31.112 port 33702 connected to 192.168.31.1 port 5201
[  9] local 192.168.31.112 port 33708 connected to 192.168.31.1 port 5201
[ 11] local 192.168.31.112 port 33718 connected to 192.168.31.1 port 5201
[ 13] local 192.168.31.112 port 33730 connected to 192.168.31.1 port 5201
[ 15] local 192.168.31.112 port 33746 connected to 192.168.31.1 port 5201
[ 17] local 192.168.31.112 port 33762 connected to 192.168.31.1 port 5201
[ 19] local 192.168.31.112 port 33772 connected to 192.168.31.1 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  14.5 MBytes   122 Mbits/sec  121    119 KBytes
[  7]   0.00-1.00   sec  14.6 MBytes   123 Mbits/sec   80    156 KBytes
[  9]   0.00-1.00   sec  14.4 MBytes   120 Mbits/sec   82    161 KBytes
[ 11]   0.00-1.00   sec  14.8 MBytes   124 Mbits/sec  129    123 KBytes
[ 13]   0.00-1.00   sec  14.4 MBytes   120 Mbits/sec   83    160 KBytes
[ 15]   0.00-1.00   sec  14.5 MBytes   121 Mbits/sec   80    154 KBytes
[ 17]   0.00-1.00   sec  14.6 MBytes   123 Mbits/sec  119    113 KBytes
[ 19]   0.00-1.00   sec  14.5 MBytes   121 Mbits/sec   82    157 KBytes
[SUM]   0.00-1.00   sec   116 MBytes   974 Mbits/sec  776
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  14.1 MBytes   118 Mbits/sec   39    147 KBytes
[  7]   1.00-2.00   sec  14.0 MBytes   117 Mbits/sec   74    134 KBytes
[  9]   1.00-2.00   sec  14.2 MBytes   120 Mbits/sec   76    139 KBytes
[ 11]   1.00-2.00   sec  14.0 MBytes   117 Mbits/sec   39    153 KBytes
[ 13]   1.00-2.00   sec  14.2 MBytes   120 Mbits/sec   78    132 KBytes
[ 15]   1.00-2.00   sec  14.1 MBytes   118 Mbits/sec   78    132 KBytes
[ 17]   1.00-2.00   sec  14.0 MBytes   117 Mbits/sec   37    144 KBytes
[ 19]   1.00-2.00   sec  14.1 MBytes   118 Mbits/sec   79    129 KBytes
[SUM]   1.00-2.00   sec   113 MBytes   947 Mbits/sec  500
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  13.9 MBytes   116 Mbits/sec   75    126 KBytes
[  7]   2.00-3.00   sec  13.9 MBytes   116 Mbits/sec   73    112 KBytes
[  9]   2.00-3.00   sec  14.0 MBytes   117 Mbits/sec   72    123 KBytes
[ 11]   2.00-3.00   sec  13.9 MBytes   116 Mbits/sec   75    133 KBytes
[ 13]   2.00-3.00   sec  14.0 MBytes   117 Mbits/sec   74    110 KBytes
[ 15]   2.00-3.00   sec  14.0 MBytes   117 Mbits/sec   74    115 KBytes
[ 17]   2.00-3.00   sec  14.0 MBytes   117 Mbits/sec   75    126 KBytes
[ 19]   2.00-3.00   sec  13.9 MBytes   116 Mbits/sec   37    160 KBytes
[SUM]   2.00-3.00   sec   112 MBytes   935 Mbits/sec  555
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  14.2 MBytes   120 Mbits/sec   69    112 KBytes
[  7]   3.00-4.00   sec  14.1 MBytes   118 Mbits/sec   40    136 KBytes
[  9]   3.00-4.00   sec  14.0 MBytes   117 Mbits/sec   37    154 KBytes
[ 11]   3.00-4.00   sec  14.1 MBytes   118 Mbits/sec   35    158 KBytes
[ 13]   3.00-4.00   sec  14.0 MBytes   117 Mbits/sec   35    144 KBytes
[ 15]   3.00-4.00   sec  14.0 MBytes   117 Mbits/sec   39    146 KBytes
[ 17]   3.00-4.00   sec  14.2 MBytes   120 Mbits/sec   37    157 KBytes
[ 19]   3.00-4.00   sec  14.1 MBytes   118 Mbits/sec   74    141 KBytes
[SUM]   3.00-4.00   sec   113 MBytes   947 Mbits/sec  366
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  13.9 MBytes   116 Mbits/sec   40    140 KBytes
[  7]   4.00-5.00   sec  14.0 MBytes   117 Mbits/sec   73    120 KBytes
[  9]   4.00-5.00   sec  14.1 MBytes   119 Mbits/sec   77    130 KBytes
[ 11]   4.00-5.00   sec  14.1 MBytes   119 Mbits/sec   78    136 KBytes
[ 13]   4.00-5.00   sec  14.1 MBytes   119 Mbits/sec   75    120 KBytes
[ 15]   4.00-5.00   sec  14.1 MBytes   119 Mbits/sec   74    123 KBytes
[ 17]   4.00-5.00   sec  13.9 MBytes   116 Mbits/sec   76    132 KBytes
[ 19]   4.00-5.00   sec  13.9 MBytes   116 Mbits/sec   77    119 KBytes
[SUM]   4.00-5.00   sec   112 MBytes   941 Mbits/sec  570
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   5.00-6.00   sec  13.8 MBytes   115 Mbits/sec   40    161 KBytes
[  7]   5.00-6.00   sec  14.0 MBytes   117 Mbits/sec   39    148 KBytes
[  9]   5.00-6.00   sec  14.0 MBytes   117 Mbits/sec   40    154 KBytes
[ 11]   5.00-6.00   sec  13.9 MBytes   116 Mbits/sec   76    113 KBytes
[ 13]   5.00-6.00   sec  14.0 MBytes   117 Mbits/sec   38    147 KBytes
[ 15]   5.00-6.00   sec  14.0 MBytes   117 Mbits/sec   38    150 KBytes
[ 17]   5.00-6.00   sec  14.0 MBytes   117 Mbits/sec   75    110 KBytes
[ 19]   5.00-6.00   sec  14.2 MBytes   120 Mbits/sec   39    148 KBytes
[SUM]   5.00-6.00   sec   112 MBytes   938 Mbits/sec  385
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   6.00-7.00   sec  14.1 MBytes   118 Mbits/sec   75    140 KBytes
[  7]   6.00-7.00   sec  14.0 MBytes   117 Mbits/sec   75    132 KBytes
[  9]   6.00-7.00   sec  14.1 MBytes   118 Mbits/sec   43    170 KBytes
[ 11]   6.00-7.00   sec  14.0 MBytes   117 Mbits/sec   38    141 KBytes
[ 13]   6.00-7.00   sec  14.0 MBytes   117 Mbits/sec   36    171 KBytes
[ 15]   6.00-7.00   sec  13.9 MBytes   116 Mbits/sec   73    134 KBytes
[ 17]   6.00-7.00   sec  14.0 MBytes   117 Mbits/sec   35    140 KBytes
[ 19]   6.00-7.00   sec  14.0 MBytes   117 Mbits/sec   72    139 KBytes
[SUM]   6.00-7.00   sec   112 MBytes   941 Mbits/sec  447
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   7.00-8.00   sec  14.2 MBytes   120 Mbits/sec   45    143 KBytes
[  7]   7.00-8.00   sec  14.0 MBytes   117 Mbits/sec   41    140 KBytes
[  9]   7.00-8.00   sec  14.0 MBytes   117 Mbits/sec   45    158 KBytes
[ 11]   7.00-8.00   sec  14.1 MBytes   118 Mbits/sec   45    143 KBytes
[ 13]   7.00-8.00   sec  13.9 MBytes   116 Mbits/sec   86    115 KBytes
[ 15]   7.00-8.00   sec  14.2 MBytes   120 Mbits/sec   45    143 KBytes
[ 17]   7.00-8.00   sec  14.0 MBytes   117 Mbits/sec   45    136 KBytes
[ 19]   7.00-8.00   sec  14.0 MBytes   117 Mbits/sec   45    150 KBytes
[SUM]   7.00-8.00   sec   112 MBytes   944 Mbits/sec  397
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   8.00-9.00   sec  14.0 MBytes   117 Mbits/sec   37    164 KBytes
[  7]   8.00-9.00   sec  14.1 MBytes   118 Mbits/sec   78    115 KBytes
[  9]   8.00-9.00   sec  14.0 MBytes   117 Mbits/sec   78    123 KBytes
[ 11]   8.00-9.00   sec  14.0 MBytes   117 Mbits/sec   40    161 KBytes
[ 13]   8.00-9.00   sec  14.1 MBytes   118 Mbits/sec   41    134 KBytes
[ 15]   8.00-9.00   sec  14.0 MBytes   117 Mbits/sec   41    161 KBytes
[ 17]   8.00-9.00   sec  14.0 MBytes   117 Mbits/sec   38    160 KBytes
[ 19]   8.00-9.00   sec  13.9 MBytes   116 Mbits/sec   80    120 KBytes
[SUM]   8.00-9.00   sec   112 MBytes   941 Mbits/sec  433
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   9.00-10.00  sec  13.9 MBytes   116 Mbits/sec   78    139 KBytes
[  7]   9.00-10.00  sec  14.1 MBytes   118 Mbits/sec   39    146 KBytes
[  9]   9.00-10.00  sec  14.1 MBytes   118 Mbits/sec   37    158 KBytes
[ 11]   9.00-10.00  sec  13.9 MBytes   116 Mbits/sec   75    140 KBytes
[ 13]   9.00-10.00  sec  14.0 MBytes   117 Mbits/sec   38    161 KBytes
[ 15]   9.00-10.00  sec  14.0 MBytes   117 Mbits/sec   79    130 KBytes
[ 17]   9.00-10.00  sec  13.9 MBytes   116 Mbits/sec   76    139 KBytes
[ 19]   9.00-10.00  sec  14.2 MBytes   119 Mbits/sec   37    151 KBytes
[SUM]   9.00-10.00  sec   112 MBytes   940 Mbits/sec  459
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   141 MBytes   118 Mbits/sec  619            sender
[  5]   0.00-10.01  sec   140 MBytes   118 Mbits/sec                  receiver
[  7]   0.00-10.00  sec   141 MBytes   118 Mbits/sec  612            sender
[  7]   0.00-10.01  sec   140 MBytes   118 Mbits/sec                  receiver
[  9]   0.00-10.00  sec   141 MBytes   118 Mbits/sec  587            sender
[  9]   0.00-10.01  sec   140 MBytes   118 Mbits/sec                  receiver
[ 11]   0.00-10.00  sec   141 MBytes   118 Mbits/sec  630            sender
[ 11]   0.00-10.01  sec   140 MBytes   118 Mbits/sec                  receiver
[ 13]   0.00-10.00  sec   141 MBytes   118 Mbits/sec  584            sender
[ 13]   0.00-10.01  sec   140 MBytes   118 Mbits/sec                  receiver
[ 15]   0.00-10.00  sec   141 MBytes   118 Mbits/sec  621            sender
[ 15]   0.00-10.01  sec   140 MBytes   118 Mbits/sec                  receiver
[ 17]   0.00-10.00  sec   141 MBytes   118 Mbits/sec  613            sender
[ 17]   0.00-10.01  sec   140 MBytes   117 Mbits/sec                  receiver
[ 19]   0.00-10.00  sec   141 MBytes   118 Mbits/sec  622            sender
[ 19]   0.00-10.01  sec   140 MBytes   118 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec  1.10 GBytes   945 Mbits/sec  4888             sender
[SUM]   0.00-10.01  sec  1.10 GBytes   941 Mbits/sec                  receiver

iperf Done.
root@BPI:~# ethtool -S eth0 | grep -i -E "drop|err|loss"
     rx_fcs_errors: 0
     rx_short_errors: 0
     rx_long_errors: 0
     rx_checksum_errors: 0
     rx_xdp_drop: 0
     rx_xdp_tx_errors: 0
     tx_xdp_xmit_errors: 0
     s00_p06_TxDrop: 0
     s00_p06_TxCrcErr: 0
     s00_p06_RxDrop: 0
     s00_p06_RxCrcErr: 0
     s00_p06_RxCtrlDrop: 0
     s00_p06_RxIngressDrop: 0
     s00_p06_RxArlDrop: 0

Wan-phy is interface wan (eth1)…have you bridged this interface to br-lan too?

What does ethtool -s tell you after the retransmitts shown in iperf3?

You can see this in the previous logs. :slight_smile:

root@BPI:~# ethtool -S eth0
NIC statistics:
     tx_bytes: 1712
     tx_packets: 16
     tx_skip: 0
     tx_collisions: 0
     rx_bytes: 0
     rx_packets: 0
     rx_overflow: 0
     rx_fcs_errors: 0
     rx_short_errors: 0
     rx_long_errors: 0
     rx_checksum_errors: 0
     rx_flow_control_packets: 0
     rx_xdp_redirect: 0
     rx_xdp_pass: 0
     rx_xdp_drop: 0
     rx_xdp_tx: 0
     rx_xdp_tx_errors: 0
     tx_xdp_xmit: 0
     tx_xdp_xmit_errors: 0
     s00_p06_TxDrop: 0
     s00_p06_TxCrcErr: 0
     s00_p06_TxCollision: 0
     s00_p06_RxDrop: 0
     s00_p06_RxFiltering: 16
     s00_p06_RxCrcErr: 0
     s00_p06_RxCtrlDrop: 0
     s00_p06_RxIngressDrop: 0
     s00_p06_RxArlDrop: 0

root@BPI:~# ls /sys/class/net/br-lan/brif/
lan1     lan2     lan3     lan4     lan5     lan6     sfp-lan
root@BPI:~# uci show network | grep -i br-lan
network.@device[0].name='br-lan'
network.lan.device='br-lan'

Wan is not eth0…eth0 is mac for internal switch.

This?

root@BPI:~# ip route get 192.168.31.1
192.168.31.1 dev wan src 192.168.31.112 uid 0
    cache
root@BPI:~# cat /etc/config/network

config interface 'loopback'
        option device 'lo'
        option proto 'static'
        list ipaddr '127.0.0.1/8'

config globals 'globals'
        option dhcp_default_duid '0004942817c6a157598b8ac5bf0514bcb6ac'
        option ula_prefix 'fdc6:37b8:88de::/48'

config device
        option name 'br-lan'
        option type 'bridge'
        list ports 'lan1'
        list ports 'lan2'
        list ports 'lan3'
        list ports 'lan4'
        list ports 'lan5'
        list ports 'lan6'
        list ports 'sfp-lan'

config interface 'lan'
        option device 'br-lan'
        option proto 'static'
        list ipaddr '192.168.1.1/24'
        option ip6assign '60'

config interface 'wan'
        option device 'wan'
        option proto 'dhcp'

config interface 'wan6'
        option device 'wan'
        option proto 'dhcpv6'

yes and here the stats were interesting, somehow my wan-phy does not come up completely…do not know why yet. in my running system i see an sfp-property which should not be there in phy-mode…i do not see it in my dts{,i,o} files…i try reflashing.

I hope it will be help to you

root@BPI:~# find /sys/firmware/devicetree/base/ -name “sfp

/sys/firmware/devicetree/base/sfp1
/sys/firmware/devicetree/base/soc/ethernet@15100000/mdio-bus/switch@16/ports/port@13/sfp
/sys/firmware/devicetree/base/soc/ethernet@15100000/mac@1/sfp
/sys/firmware/devicetree/base/sfp2
/sys/firmware/devicetree/base/__symbols__/sfp1
/sys/firmware/devicetree/base/__symbols__/imux1_sfp1
/sys/firmware/devicetree/base/__symbols__/imux2_sfp2
/sys/firmware/devicetree/base/__symbols__/sfp2

root@BPI:~# ls -la /sys/firmware/devicetree/base/soc/ethernet@*

-r--r--r--    1 root     root             4 Sep  2 17:46 #address-cells
-r--r--r--    1 root     root             4 Sep  2 17:46 #size-cells
drwxr-xr-x    6 root     root             0 Jan  1  1970 .
drwxr-xr-x   63 root     root             0 Jan  1  1970 ..
-r--r--r--    1 root     root            48 Sep  2 17:46 assigned-clock-parents
-r--r--r--    1 root     root            48 Sep  2 17:46 assigned-clocks
-r--r--r--    1 root     root           324 Sep  2 17:46 clock-names
-r--r--r--    1 root     root           192 Sep  2 17:46 clocks
-r--r--r--    1 root     root            20 Sep  2 17:46 compatible
-r--r--r--    1 root     root            40 Sep  2 17:46 interrupt-names
-r--r--r--    1 root     root            96 Sep  2 17:46 interrupts
drwxr-xr-x    3 root     root             0 Jan  1  1970 mac@0
drwxr-xr-x    2 root     root             0 Jan  1  1970 mac@1
drwxr-xr-x    3 root     root             0 Jan  1  1970 mac@2
drwxr-xr-x    4 root     root             0 Sep  2 17:46 mdio-bus
-r--r--r--    1 root     root             4 Sep  2 17:46 mediatek,ethsys
-r--r--r--    1 root     root             4 Sep  2 17:46 mediatek,infracfg
-r--r--r--    1 root     root            12 Sep  2 17:46 mediatek,wed
-r--r--r--    1 root     root             9 Sep  2 17:46 name
-r--r--r--    1 root     root             4 Sep  2 17:46 phandle
-r--r--r--    1 root     root             4 Sep  2 17:46 pinctrl-0
-r--r--r--    1 root     root             8 Sep  2 17:46 pinctrl-names
-r--r--r--    1 root     root            16 Sep  2 17:46 reg
-r--r--r--    1 root     root             4 Sep  2 17:46 sram
-r--r--r--    1 root     root             5 Sep  2 17:46 status

mhm, after rebuilding and flashing i get a trace when bootup process tries to bring up wan…really strange…seems like something has changed…still do not see the sfp property on mac@1 in any dts{,i,o}

ah, it looks like i miss the phy driver/firmware in my current state…maybe i had it enabled manually

Symbol: PACKAGE_mt7988-2p5g-phy-firmware [=n] 
Symbol: PACKAGE_kmod-phy-mediatek-2p5g [=n]

wonder why this happened because i have it enabled…maybe because switching between 4e and 8x board without distclean

define Device/bananapi_bpi-r4-pro-4e
  DEVICE_MODEL := BPi-R4 Pro 4E
  DEVICE_DTS := mt7988a-bananapi-bpi-r4-pro-4e
  DEVICE_DTS_CONFIG := config-mt7988a-bananapi-bpi-r4-pro-4e
  DEVICE_BL2 := comb
  $(call Device/bananapi_bpi-r4-pro-common)
  DEVICE_PACKAGES += mt7988-2p5g-phy-firmware
  DEVICE_DTS_OVERLAY += mt7988a-bananapi-bpi-r4-pro-4e-wan-phy mt7988a-bananapi-bpi-r4-pro-4e-wan-sfp
endef
TARGET_DEVICES += bananapi_bpi-r4-pro-4e

looks better now

[   21.599531] mtk_soc_eth 15100000.ethernet wan: PHY [mdio-bus:0f] driver [MediaTek MT7988 2.5GbE PHY] (irq=POLL)
[   21.609674] mtk_soc_eth 15100000.ethernet wan: configuring for phy/internal link mode

vs.

[   18.519501] mtk_soc_eth 15100000.ethernet wan: PHY [mdio-bus:0f] driver [Generic Clause 45 PHY] (irq=POLL)
[   18.529238] mtk_soc_eth 15100000.ethernet wan: configuring for phy/internal link mode
[   18.537093] ------------[ cut here ]------------
[   18.541730] _phy_start_aneg+0x0/0xa0: returned: -22
[   18.546701] WARNING: CPU: 0 PID: 93 at _phy_state_machine+0x100/0x3e0
[   18.553142] Modules linked in: pppoe ppp_async nft_flow_offload nft_fib_inet nf_flow_table_inet nf_flow_table pppox ppp_generic nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject nft_redir nft_quota nft
[   18.629306] CPU: 0 UID: 0 PID: 93 Comm: kworker/u16:3 Tainted: G           O        6.18.44 #0 NONE 
[   18.638430] Tainted: [O]=OOT_MODULE
[   18.641908] Hardware name: Bananapi BPI-R4 Pro 4E (DT)
[   18.647034] Workqueue: events_power_efficient phy_state_machine
[   18.652945] pstate: 60400005 (nZCv daif +PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[   18.659895] pc : _phy_state_machine+0x100/0x3e0
[   18.664414] lr : _phy_state_machine+0x100/0x3e0
...

already noticed, that the device-specific defaults are not taken when selecting another board (here R4pro 8x vs. 4e), not sure how to solve without distclean and rebuilding .config

but back to the retransmitts…i have them only in sending direction and less count than you

root@OpenWrt:~# iperf3 -c 192.168.0.21
Connecting to host 192.168.0.21, port 5201
[  5] local 192.168.0.102 port 59954 connected to 192.168.0.21 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   114 MBytes   952 Mbits/sec    0    656 KBytes       
[  5]   1.00-2.00   sec   113 MBytes   945 Mbits/sec    5    361 KBytes       
[  5]   2.00-3.00   sec   112 MBytes   943 Mbits/sec    2    298 KBytes       
[  5]   3.00-4.00   sec   112 MBytes   942 Mbits/sec    0    506 KBytes       
[  5]   4.00-5.00   sec   112 MBytes   940 Mbits/sec    4    294 KBytes       
[  5]   5.00-6.00   sec   112 MBytes   937 Mbits/sec    1    345 KBytes       
[  5]   6.00-7.00   sec   112 MBytes   942 Mbits/sec    0    529 KBytes       
[  5]   7.00-8.00   sec   112 MBytes   943 Mbits/sec    4    379 KBytes       
[  5]   8.00-9.00   sec   112 MBytes   943 Mbits/sec    5    303 KBytes       
[  5]   9.00-10.00  sec   112 MBytes   941 Mbits/sec    0    477 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  1.10 GBytes   943 Mbits/sec   21            sender
[  5]   0.00-10.00  sec  1.10 GBytes   941 Mbits/sec                  receiver

iperf Done.
root@OpenWrt:~# iperf3 -R -c 192.168.0.21
Connecting to host 192.168.0.21, port 5201
Reverse mode, remote host 192.168.0.21 is sending
[  5] local 192.168.0.102 port 57768 connected to 192.168.0.21 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec   112 MBytes   939 Mbits/sec                  
[  5]   1.00-2.00   sec   112 MBytes   940 Mbits/sec                  
[  5]   2.00-3.00   sec   112 MBytes   941 Mbits/sec                  
[  5]   3.00-4.00   sec   112 MBytes   938 Mbits/sec                  
[  5]   4.00-5.00   sec   112 MBytes   938 Mbits/sec                  
[  5]   5.00-6.00   sec   112 MBytes   940 Mbits/sec                  
[  5]   6.00-7.00   sec   112 MBytes   940 Mbits/sec                  
[  5]   7.00-8.00   sec   112 MBytes   940 Mbits/sec                  
[  5]   8.00-9.00   sec   112 MBytes   940 Mbits/sec                  
[  5]   9.00-10.00  sec   112 MBytes   940 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  1.10 GBytes   941 Mbits/sec    0            sender
[  5]   0.00-10.00  sec  1.09 GBytes   939 Mbits/sec                  receiver

iperf Done.

root@OpenWrt:~# ethtool -S wan
NIC statistics:
     tx_bytes: 1234654529
     tx_packets: 858180
     tx_skip: 0
     tx_collisions: 0
     rx_bytes: 1230219181
     rx_packets: 837928
     rx_overflow: 0
     rx_fcs_errors: 0
     rx_short_errors: 0
     rx_long_errors: 0
     rx_checksum_errors: 0
     rx_flow_control_packets: 0
     rx_xdp_redirect: 0
     rx_xdp_pass: 0
     rx_xdp_drop: 0
     rx_xdp_tx: 0
     rx_xdp_tx_errors: 0
     tx_xdp_xmit: 0
     tx_xdp_xmit_errors: 0

maybe caused by client/switch between client and server, or something must settle a bit…did a bidir after the first run which is completely clean (could be lower layer too - tcp window, MTU path discovery or such)

root@OpenWrt:~# iperf3 --bidir -c 192.168.0.21
Connecting to host 192.168.0.21, port 5201
[  5] local 192.168.0.102 port 52736 connected to 192.168.0.21 port 5201
[  7] local 192.168.0.102 port 52752 connected to 192.168.0.21 port 5201
[ ID][Role] Interval           Transfer     Bitrate         Retr  Cwnd
[  5][TX-C]   0.00-1.00   sec   113 MBytes   944 Mbits/sec    0    731 KBytes       
[  7][RX-C]   0.00-1.00   sec   112 MBytes   935 Mbits/sec                  
[  5][TX-C]   1.00-2.00   sec   111 MBytes   929 Mbits/sec    0    771 KBytes       
[  7][RX-C]   1.00-2.00   sec   112 MBytes   935 Mbits/sec                  
[  5][TX-C]   2.00-3.00   sec   112 MBytes   938 Mbits/sec    0    771 KBytes       
[  7][RX-C]   2.00-3.00   sec   112 MBytes   935 Mbits/sec                  
[  5][TX-C]   3.00-4.00   sec   111 MBytes   930 Mbits/sec    0    771 KBytes       
[  7][RX-C]   3.00-4.00   sec   112 MBytes   935 Mbits/sec                  
[  5][TX-C]   4.00-5.00   sec   111 MBytes   929 Mbits/sec    0    771 KBytes       
[  7][RX-C]   4.00-5.00   sec   112 MBytes   935 Mbits/sec                  
[  5][TX-C]   5.00-6.00   sec   111 MBytes   934 Mbits/sec    0    771 KBytes       
[  7][RX-C]   5.00-6.00   sec   112 MBytes   935 Mbits/sec                  
[  5][TX-C]   6.00-7.00   sec   111 MBytes   930 Mbits/sec    0    771 KBytes       
[  7][RX-C]   6.00-7.00   sec   112 MBytes   937 Mbits/sec                  
[  5][TX-C]   7.00-8.00   sec   111 MBytes   933 Mbits/sec    0    771 KBytes       
[  7][RX-C]   7.00-8.00   sec   112 MBytes   935 Mbits/sec                  
[  5][TX-C]   8.00-9.00   sec   111 MBytes   932 Mbits/sec    0    771 KBytes       
[  7][RX-C]   8.00-9.00   sec   112 MBytes   936 Mbits/sec                  
[  5][TX-C]   9.00-10.00  sec   111 MBytes   934 Mbits/sec    0    771 KBytes       
[  7][RX-C]   9.00-10.00  sec   112 MBytes   937 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID][Role] Interval           Transfer     Bitrate         Retr
[  5][TX-C]   0.00-10.00  sec  1.09 GBytes   933 Mbits/sec    0            sender
[  5][TX-C]   0.00-10.00  sec  1.09 GBytes   932 Mbits/sec                  receiver
[  7][RX-C]   0.00-10.00  sec  1.09 GBytes   939 Mbits/sec    0            sender
[  7][RX-C]   0.00-10.00  sec  1.09 GBytes   936 Mbits/sec                  receiver

iperf Done.

Have you used same cable,client,switchports for sfp and phy test? Could be pause/flowcontrol-setting on the way

1 Like

Just to clarify: in my previous test on wan-phy, I had 0 retransmits across all runs in both directions (Retr: 0 on TX and -R RX).

Regarding my physical setup:

  • Cable: The exact same cable was used for both tests.
  • Topology / Switch: BPI-R4 was connected through a 5-port 1 Gbps switch to the main router (AX6000 at 192.168.31.1).
  • Ports: The port on the main router (AX6000) remained unchanged throughout the tests.

AI think:

In your case, rx_flow_control_packets: 0 in ethtool points to disabled Pause frames. On a direct link or small switch buffers, microbursts easily cause buffer overruns during unidirectional TX, forcing TCP Cwnd to collapse (from 656 KB down to ~294 KB). In --bidir mode, incoming ACK pacing naturally smooths out the traffic bursts, which kept your Cwnd stable at 771 KB with zero drops.

UPD2:

@frank-w

I Checked Flow Control on wan interface with AI:

  • Autonegotiate: on
  • RX negotiated: on / TX negotiated: on
  • rx_overflow: 0
  • rx_flow_control_packets: 0

In my setup, symmetric Pause frame negotiation succeeded with the intermediate switch. The absence of rx_overflow and 0 retransmits even under --bidir confirms the MT7988 PHY/MAC handles full-duplex line rate gracefully when Flow Control auto-negotiation is properly resolved by the link partner.

root@BPI:~# iperf3 -c 192.168.31.1 --bidir

Connecting to host 192.168.31.1, port 5201
[  5] local 192.168.31.112 port 55670 connected to 192.168.31.1 port 5201
[  7] local 192.168.31.112 port 55674 connected to 192.168.31.1 port 5201
[ ID][Role] Interval           Transfer     Bitrate         Retr  Cwnd
[  5][TX-C]   0.00-1.00   sec   112 MBytes   941 Mbits/sec    0   1017 KBytes
[  7][RX-C]   0.00-1.00   sec   111 MBytes   931 Mbits/sec
[  5][TX-C]   1.00-2.00   sec   112 MBytes   937 Mbits/sec    0   1017 KBytes
[  7][RX-C]   1.00-2.00   sec   111 MBytes   933 Mbits/sec
[  5][TX-C]   2.00-3.00   sec   111 MBytes   929 Mbits/sec    0   1.13 MBytes
[  7][RX-C]   2.00-3.00   sec   109 MBytes   914 Mbits/sec
[  5][TX-C]   3.00-4.00   sec   110 MBytes   921 Mbits/sec    0   1.22 MBytes
[  7][RX-C]   3.00-4.00   sec   109 MBytes   911 Mbits/sec
[  5][TX-C]   4.00-5.00   sec   111 MBytes   934 Mbits/sec    0   1.22 MBytes
[  7][RX-C]   4.00-5.00   sec   110 MBytes   924 Mbits/sec
[  5][TX-C]   5.00-6.00   sec   112 MBytes   938 Mbits/sec    0   1.22 MBytes
[  7][RX-C]   5.00-6.00   sec   111 MBytes   933 Mbits/sec
[  5][TX-C]   6.00-7.00   sec   112 MBytes   938 Mbits/sec    0   1.28 MBytes
[  7][RX-C]   6.00-7.00   sec   111 MBytes   931 Mbits/sec
[  5][TX-C]   7.00-8.00   sec   112 MBytes   942 Mbits/sec    0   1.28 MBytes
[  7][RX-C]   7.00-8.00   sec   111 MBytes   932 Mbits/sec
[  5][TX-C]   8.00-9.00   sec   112 MBytes   937 Mbits/sec    0   1.28 MBytes
[  7][RX-C]   8.00-9.00   sec   111 MBytes   933 Mbits/sec
[  5][TX-C]   9.00-10.00  sec   112 MBytes   938 Mbits/sec    0   1.28 MBytes
[  7][RX-C]   9.00-10.00  sec   111 MBytes   933 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID][Role] Interval           Transfer     Bitrate         Retr
[  5][TX-C]   0.00-10.00  sec  1.09 GBytes   936 Mbits/sec    0            sender
[  5][TX-C]   0.00-10.01  sec  1.09 GBytes   933 Mbits/sec                  receiver
[  7][RX-C]   0.00-10.00  sec  1.08 GBytes   931 Mbits/sec    0            sender
[  7][RX-C]   0.00-10.01  sec  1.08 GBytes   927 Mbits/sec                  receiver

iperf Done.

root@BPI:~# iperf3 -c 192.168.31.1 -b 930M

Connecting to host 192.168.31.1, port 5201
[  5] local 192.168.31.112 port 42510 connected to 192.168.31.1 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   111 MBytes   930 Mbits/sec    0    496 KBytes
[  5]   1.00-2.00   sec   111 MBytes   929 Mbits/sec    0    496 KBytes
[  5]   2.00-3.00   sec   109 MBytes   913 Mbits/sec    0    496 KBytes
[  5]   3.00-4.00   sec   113 MBytes   947 Mbits/sec    0    588 KBytes
[  5]   4.00-5.00   sec   111 MBytes   930 Mbits/sec    0    588 KBytes
[  5]   5.00-6.00   sec   110 MBytes   924 Mbits/sec    0    699 KBytes
[  5]   6.00-7.00   sec   112 MBytes   936 Mbits/sec    0    699 KBytes
[  5]   7.00-8.00   sec   111 MBytes   930 Mbits/sec    0    699 KBytes
[  5]   8.00-9.00   sec   111 MBytes   930 Mbits/sec    0    699 KBytes
[  5]   9.00-10.00  sec   111 MBytes   930 Mbits/sec    0    775 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  1.08 GBytes   930 Mbits/sec    0            sender
[  5]   0.00-10.00  sec  1.08 GBytes   930 Mbits/sec                  receiver

iperf Done.

root@BPI:~# ls /sys/class/net/

br-lan   eth2     lan2     lan4     lan6     sfp-lan
eth0     lan1     lan3     lan5     lo       wan

root@BPI:~# ethtool -a wan

Pause parameters for wan:
Autonegotiate:  on
RX:             off
TX:             off
RX negotiated:  on
TX negotiated:  on

root@BPI:~# ethtool -S wan | grep -i flow

     rx_overflow: 0
     rx_flow_control_packets: 0
1 Like

Have 4E board stop flags for merge in openwrt?

Afaik all notes from ai review should be fixed. just a reviewer needs time to look over it

2 Likes