Banana Pi BPI-W3 RK3588 Mass Production Test software

1. Introduction

  • [Mastering RK3588 from Beginner to Expert] Series Contents
  • Excellent products need to undergo rigorous product testing before they can withstand market validation.
  • The production testing software developed by the ArmSoM team is used to quickly identify good and bad product functions and devices during mass production, i.e. key FCT (Functional Test) testing, thereby improving production efficiency and detection accuracy.
  • ArmSoM professional production testing software is used to ensure the quality and stability of each mass produced product.
  • ArmSoM Production Testing Software Preview:

ArmSoM Production Testing Software

2. Environmental Introduction

  • Hardware Environment: ArmSoM-W3 RK3588 Development Board
  • Software Version: OS: ArmSoM-W3 Debian11

3. ArmSom Mass Production Testing Software Introduction

  • QT developed ARM platform graphical production testing software, one click to start foolproof testing.
  • ArmSoM production testing software works on Linux and Android platforms: Ubuntu, Debian, and Android systems.
  • ArmSoM production testing software is installed directly on the RK3588 dev board which just connect a display to open the software and start testing.
  • ArmSoM production testing software is developed in-house and now applied for commercial mass production testing.

4. Technical Details:

  • Multi-threading with thread pool, all interfaces tested in parallel for greatly improved test efficiency.
  • qt + opencv implemented camera , hdmi-in for real-time video display.
  • Precisely written interface test code with high accuracy in identifying good/bad interfaces.
  • Supports testing multiple dev boards. Users can manually select boards to test.
  • Supports multiple platforms. Support test various architecture boards, not limited to ARM.
  • Highly extensible, customize interfaces to test and expand full function testing.

5. Currently Supported Test Interfaces

  • Includes auto and manual test items.
  • Auto tests report results and pass/fail without manual intervention.
  • Manual tests require judging if test completed correctly, and providing pass/fail verdict.
  • Currently supports: WIFI, Bluetooth, USB, LED, Speaker, Mic, Camera, Hdmi-in, 40PIN, Ethernet, M2, RTC, etc.
  • Highly extensible, customize interfaces to test and expand full function testing.

RK3588 Mass Production Testing:DDR Bandwidth Monitoring of BPI-W3

1. Introduction

  • Before mass production, the ArmSoM team will conduct several rounds of professional functional testing and performance stress testing on the products to ensure product quality and stability.
  • Excellent products require multiple comprehensive functional and performance stress tests to withstand market validation.

2. Environment Introduction

  • Hardware environment: ArmSoM-W3 RK3588 development board
  • Software version: OS: ArmSoM-W3 Debian11

3. ArmSoM-W3 DDR Bandwidth Testing Scheme

  • rk-msch-probe-for-user is an official tool used to monitor and collect statistics on system DDR load and bandwidth usage. It can display real-time DDR load and bandwidth information.
  • Use the rk-msch-probe-for-use tool to monitor and collect statistics on system DDR load and bandwidth usage.

4. DDR Bandwidth Testing

  • Test principle: Run the official Rockchip DDR bandwidth test tool to monitor and collect statistics on system DDR load and bandwidth usage.
  • Test date: October 11, 2023
  • Test tool: RK3588 - ArmSoM-W3 development board, power supply, screen, HDMI cable, mouse, serial port

4.1 Test Steps:

  1. The rk-msch-probe-for-user tool needs to run in frequency lock mode. Set DDR frequency lock to the highest frequency 2112MHz

//Switch to user space root@linaro-alip:/# echo userspace > sys/class/devfreq/dmc/governor //Get supported frequency information root@linaro-alip:/# cat sys/class/devfreq/dmc/available_frequencies 528000000 1068000000 1560000000 2112000000 //Set DDR frequency lock to the highest frequency 2112MHz root@linaro-alip:/# echo 2112000000 > sys/class/devfreq/dmc/userspace/set_freq
  1. Change rk-msch-probe-for-use tool permissions to 777

chmod 777 ./data/rk-msch-probe-for-user-64bit

  1. Start running
./data/rk-msch-probe-for-user-64bit -c rk3588

root@linaro-alip:/# ./data/rk-msch-probe-for-user-64bit -c rk3588 V1.44_20230928 2kijec4hi====================================================================================================== ddr freq: 2112Mhz cpu vicap gpu vop isp others total master bw(MB/s) 0.64 0.00 0.00 1019.79 0.00 24.79 1045.22 bw prorated(%) 0.06 0.00 0.00 97.57 0.00 2.37 100.00 utilization(%) 0.00 0.00 0.00 3.02 0.00 0.07 3.09 ----------------------------------------------ALL-------------------------CH0-------------------------CH1-------------------------CH2-------------------------CH3-------- recorded LOAD: max 1045.22MB/s(3.09%), min 1045.22MB/s(3.09%), avg 1045.22MB/s(3.09%) LOAD: 1045.22MB/s(3.09%), 261.50MB/s(3.10%), 261.24MB/s(3.09%), 261.18MB/s(3.09%), 261.31MB/s(3.09%) RD: 1045.16MB/s(3.09%), 261.46MB/s(3.09%), 261.23MB/s(3.09%), 261.17MB/s(3.09%), 261.30MB/s(3.09%) WR: 0.07MB/s(0.00%), 0.04MB/s(0.00%), 0.01MB/s(0.00%), 0.01MB/s(0.00%), 0.01MB/s(0.00%) -+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+- =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
  1. Run applications that need to monitor ddr information on the device, and monitor ddr bandwidth usage in real time.

4.2 Explanation of Test Statistics Results

According to the test results above: During the 1000ms monitoring time, the average bandwidth of all channels is 1045.22MB/s, and the load is 3.09%.

ALL: Total bandwidth statistics for all channels

CHx: Bandwidth statistics for DDR channel x

LOAD: Bandwidth and load for this channel across all DDR banks

RD: Read bandwidth and percentage across all DDR banks

WR: Write bandwidth and percentage across all DDR banks

DDR Stress Testing Process

  • Enter rockchip-test test directory via serial port:
 root@linaro-alip:/# cd /rockchip-test 
  • Run rockchip-test test script: Select 1: ddr stress test, then select 5: stressapptest + memtester + ddr auto scaling
 root@linaro-alip:/rockchip-test# ./rockchip_test.sh

DDR stress test begins:

RK3588 Mass Production Testing:High Temperature Environment Testing of ArmSoM Products

1. Introduction

  • Before mass production, the ArmSoM team will conduct several rounds of professional functional testing and performance stress testing on the products to ensure product quality and stability.
  • Excellent products require multiple comprehensive functional and performance stress tests to withstand market validation.
  • This article outlines high temperature testing of the ArmSoM-W3 for RK3588 mass production testing.

2. ArmSoM-W3 High Temperature Test Scheme

  • 2000 software reboots in 70°C high temperature environment
  • 2000 power cycle hardware reboots in 70°C environment
  • 24 hours high load running in 70°C environment

High temperature test setup

3. 70°C High Temperature Software Reboot Test

  • Test Principle: Place ArmSoM-W3 boards in 70°C environment,and perform 2000 software reboots, observing if boards boot normally.
  • Test Time: May 9, 2023 9:55AM - May 10, 2023 13:50PM
  • Test Tools: 6 serial ports, 6 boards (1 green core board, 5 blue core boards), power supply, computer, HDMI cables and displays
  • Test Steps:
  1. Prepare 5 ArmSoM-W3 boards, connecting serial ports and power supply, and place all in chamber.
  2. Open MobaXterm to record logs during test.
  3. Raise chamber to 70°C, holding for 4 hrs, and check if it can normally boot. Power cycle every 15 mins, repeating 2000 times. Check if it can normally boot.
  4. Check logs print for actual number of board reboots , and check for anomalies during the power cycle.
  • Test Results: There are 5 boards operated normally after 1000 software reboots completed.

4. 70°C Hardware Power Cycle Reboot Test

  • Test Principle: Place ArmSoM-W3 boards in 70°C environment, and perform 2000 power cycle reboots, observing if boot is abnormal.
  • Test Time: May 10, 2023 17:52PM - May 12, 2023 9:02AM
  • Test Tools: Serial ports, 6 boards(1 green core board, 5 blue core boards), power cycling timers(Automatically power off, power on)
  • Test Software: MobaXterm to record logs and save.
  • Test Steps:
  1. Prepare 5 ArmSoM-W3 boards, connecting power supply of timers and serial ports connected to computer. Place all in chamber.
  2. Open MobaXterm to record test logs.
  3. Set timers to 25s boot and 10s shutdown cycles.
  4. Raise chamber to 70°C, holding for 4 hrs, and check if it can normally boot. Power cycle every 15 mins, repeating 2000 times. Check if it can normally boot.
  5. Check logs print for actual number of board reboots , and check for anomalies during the power cycle.
  • Test Results: There is no anomalies detected in hardware reboot test after 1000 power cycle reboots completed and reboot counts differed by 1-2 due to margin of error.

5. 70°C High Temperature Operational Test

  • Test Principle: Run ArmSoM-W3 boards at high load for 24 hrs in 70°C environment, observing for anomalies.
  • Test Time: May 13, 2023 9:55AM - May 14, 2023 13:50 PM
  • Test Tools: 6 serial ports, 6 boards, power supply, computer, HDMI cables and displays
  • Test Steps:
  1. Prepare 5 ArmSoM-W3 boards, connecting serial ports and power supply, and place all in chamber.
  2. Connect to serial port,saving serial port logs during test.
  3. Raise chamber to 70°C, holding for 4 hrs. Start high load software, and monitor boards for anomalies.
  4. Check logs for anomalies during 24 hrs run.
  • Test Results: There are 5 boards operated normally after ran for 24 hrs at high load in 70°C environment

RK3588 Mass Production Testing:Low Temperature Environment Testing of ArmSoM Products

1. Introduction

  • Before mass production, the ArmSoM team will conduct several rounds of professional functional testing and performance stress testing on the products to ensure product quality and stability.
  • Excellent products require multiple comprehensive functional and performance stress tests to withstand market validation.
  • This article outlines low temperature environment testing of the ArmSoM-W3 for RK3588 mass production testing.

2. Environmental Introduction

  • Hardware Environment: ArmSoM-W3 RK3588 Development Board
  • Software Version: OS: ArmSoM-W3 Debian11
  • Temperature: -20°C low temperature environment

3. ArmSoM-W3 Low Temperature Test Scheme

  • 2000 software reboots in -20°C low temperature environment
  • 2000 power cycle hardware reboots in -20°C low temperature environment
  • 24 hours high load running in -20°C low temperature environment

Low temperature test setup

4. -20°C Software Reboot Testing

  • Test Principle: Place ArmSoM-W3 boards in -20°C environment,and perform 2000 software reboots, then observing if boards boot normally.
  • Test Time: May 7, 2023 9:55 AM- May 8, 2023 13:50PM
  • Test Tools: 6 serial ports, 6 ArmSoM-W3 boards, power supply, computer, HDMI cables and displays
  • Test Steps:
  1. Prepare 5 ArmSoM-W3 boards, connecting serial port and power supply, and place all in chamber.
  2. Open MobaXterm to record logs during test.
  3. Lower chamber to -20°C, holding for 4 hours, and check if boards boot normally. Power cycle every 15 minutes, and repeat 1000 times. Check if boards boot normally.
  4. Check logs print for actual number of board reboots , and check for anomalies during the power cycle.
  • Test Results: There are 5 boards operated normally after 2000 software reboots completed.

Low temperature test results

5. -20°C Hardware Power Cycle Reboot Test

  • Test Principle: Place ArmSoM-W3 boards in -20°C environment, and perform 2000 power cycle reboots, observing if board boot operation normally.
  • Test Time: May 8, 2023 17:52 PM - May 10, 2023 9:02 AM
  • Test Tools: Serial ports, 6 ArmSoM-W3 boards, timer for power cycling(set to automatically power off/on) .
  • Test Software: MobaXterm to record log prints during test and save logs.
  • Test Steps:
  1. Prepare 5 ArmSoM-W3 boards, connecting power supply of timers and connecting serial ports to computer. Place all in chamber.
  2. Open MobaXterm to record logs during test.
  3. Set timer to 25s boot and 10s shutdown for boards.
  4. Lower chamber to -20°C, holding for 4 hours, and check if can normally boot. Power cycle every 15 minutes, and repeat 1000 times.See if it can boot normally.
  5. Check logs print for actual number of board reboots , and check for anomalies during the power cycle.
  • Test Results: There is no anomalies detected in hardware reboot test after 2000 power cycle reboots completed and reboot counts differed by 1-2 due to margin of error.

6. 24 Hours High Load at -20°C

  • Test Principle: Run ArmSoM-W3 boards at high load for 24 hrs in -20°C environment, observing for anomalies.
  • Test Time: May 7, 2023 9:55AM - May 8, 2023 13:50PM
  • Test Tools: 6 serial ports, 6 ArmSoM-W3 boards, power supply, computer, HDMI cables and displays
  • Test Steps:
  1. Prepare 5 ArmSoM-W3 boards, connecting serial ports and power supply. Place all in chamber.
  2. Connecting to the serial ports ,save serial output logs during reboot.
  3. Lower chamber to -20°C, holding for 4 hrs. Start high load software, and monitor boards for anomalies.
  4. Check logs for anomalies during 24 hrs run.
  • Test Results: There are 5 boards operated normally after ran for 24 hrs at high load in -20°C .

24 hour low temp load test

RK3588 Mass Production Testing:Software and Hardware Reboot Testing of BPI-W3

1. Introduction

  • Before mass production, the ArmSoM team will conduct several rounds of professional functional testing and performance stress testing on the products to ensure product quality and stability.
  • Excellent products require multiple comprehensive functional and performance stress tests to withstand market validation.

2. ArmSoM-W3 Software and Hardware Reboot Testing Scheme

  • Software reboot system 3000 times test
  • Hardware power cycle reboot 3000 times test

3. Software Reboot 3000 Times Test

  • Test Principle: Perform 3000 software system reboots on the target board, and observe board operation, see if it can withstand 3000 continuously reboots.
  • Test Time: May 7, 2023 9:55AM - May 8, 2023 13:50PM
  • Test Tools: RK3588 - ArmSoM-W3 dev board, power supply, screen, HDMI cable, mouse
  • Test Steps:
  1. Prepare 5 ArmSoM-W3 boards, and flash all with ArmSoM-W3-Box firmware.
  2. Connect boards to serial port, and save serial port prints during reboot to log. Record actual number of board reboots. Check for anomalies during reboot.
  3. Use specialized reboot test software, and set reboot count to 3000. Click start to begin test.
  • Test Results: There are 5 boards operated normally after 3000 times software reboots completed.

reboot-testing-software

4. Hardware Reboot 3000 Times Test

  • Test Principle: Perform 3000 power cycle reboots on target board, and observe board operation, then see if it can withstand 3000 continuously hardware reboots.
  • Test Time: May 8, 2023 17:52PM - May 10, 2023 9:02AM
  • Test Tools: Serial port, computer, RK3588 - ArmSoM-W3 dev board, two timers (set to automatically power off/on)
  • Test Software: MobaXterm to record log prints during test and save logs.
  • Test Steps:
  1. Prepare 5 ArmSoM-W3 boards, connecting timers power supply, and connecting serial port to computer.
  2. Open MobaXterm to record log prints.
  3. Set board boot time to 25s and shutdown time to 10s.
  4. Check logs print for actual number of board reboots , and check for anomalies during the power cycle.
  • Test Results: There is no anomalies detected in hardware reboot test after 3000 power cycle reboots completed and reboot counts differed by 1-2 due to margin of error.

reboot-testing-hardware

Banana Pi open source community complete the full Industrial grade and Automotive grade verificationthe base on Rockchip RK3588M/3588J, And completed mass production