+------------------------------------------------------------------+---------------+---------------+------------------------+ | Test Case | 2210.0-11 | 2302.0-11 | 2302.0-11 vs 2210.0-11 | +------------------------------------------------------------------+---------------+---------------+------------------------+ | 1518b-2t2c-ethip4udpwireguard4tnlsw-ip4base | 0.27 +- 0.0 | 0.49 +- 0.08 | +85.33 +- 30.19 | | 1518b-2t2c-ethip4udpwireguard1tnlsw-ip4base | 0.27 +- 0.0 | 0.34 +- 0.13 | +29.02 +- 47.01 | | 1518b-2t2c-ethip4udpwireguard8tnlsw-ip4base | 0.43 +- 0.14 | 0.52 +- 0.0 | +20.15 +- 39.87 | | imix-2t2c-ethip4udpwireguard4tnlsw-ip4base | 1.15 +- 0.51 | 1.37 +- 0.31 | +19.49 +- 59.5 | | imix-2t2c-ethip4udpwireguard1000tnlsw-ip4base | 1.21 +- 0.1 | 1.32 +- NaN | +9.12 +- NaN | | 64b-2t2c-eth-l2xcbase | 15.64 +- 1.46 | 16.2 +- 0.09 | +3.61 +- 9.7 | | 1518b-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 0.92 +- 0.24 | 0.95 +- 0.2 | +3.54 +- 34.46 | | imix-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.43 +- 0.09 | 0.44 +- 0.11 | +3.07 +- 33.12 | | 1518b-2t2c-ethip4udpwireguard100tnlsw-ip4base | 0.49 +- 0.01 | 0.5 +- 0.01 | +2.17 +- 2.43 | | 1518b-2t2c-ethip4udpwireguard1000tnlsw-ip4base | 0.45 +- 0.01 | 0.46 +- NaN | +1.58 +- NaN | | imix-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.52 +- 0.0 | 0.52 +- 0.0 | +0.95 +- 0.36 | | 78b-2t2c-ethip6-ip6scale20k | 9.34 +- 0.11 | 9.41 +- 0.06 | +0.82 +- 1.31 | | imix-2t2c-ethip4udpwireguard100tnlsw-ip4base | 1.39 +- NaN | 1.4 +- 0.02 | +0.8 +- NaN | | 1518b-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.17 +- 0.0 | 0.17 +- 0.0 | +0.39 +- 0.52 | | 64b-2t2c-ethip4vxlan-l2bdbasemaclrn | 8.74 +- 0.02 | 8.75 +- 0.03 | +0.05 +- 0.43 | | 64b-2t2c-eth-l2bdbasemaclrn | 13.41 +- 0.07 | 13.41 +- 0.04 | +0.01 +- 0.61 | | 64b-2t2c-ethip4-ip4base | 12.62 +- 0.06 | 12.6 +- 0.1 | -0.2 +- 0.92 | | 64b-2t2c-ethip4vxlan-l2xcbase | 9.88 +- 0.08 | 9.85 +- 0.09 | -0.28 +- 1.27 | | 78b-2t2c-ethip6-ip6scale20k-rnd | 9.63 +- 0.06 | 9.6 +- 0.09 | -0.29 +- 1.17 | | 64b-2t2c-eth-l2bdscale10kmaclrn | 11.59 +- 0.03 | 11.56 +- 0.09 | -0.3 +- 0.81 | | 78b-2t2c-ethip6-ip6base | 12.52 +- 0.06 | 12.48 +- 0.15 | -0.33 +- 1.24 | | 64b-2t2c-ethip4-ip4scale20k | 11.39 +- 0.07 | 11.34 +- 0.13 | -0.42 +- 1.31 | | 64b-2t2c-ethip4-ip4scale20k-rnd | 11.28 +- 0.04 | 11.23 +- 0.09 | -0.42 +- 0.88 | | 1518b-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 1.09 +- 0.0 | 1.08 +- 0.0 | -0.45 +- 0.56 | | imix-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 2.17 +- 0.01 | 2.16 +- 0.01 | -0.7 +- 0.73 | | 64b-2t2c-eth-l2patch | 22.12 +- 0.18 | 21.63 +- 1.13 | -2.21 +- 5.19 | | imix-2t2c-ethip4udpwireguard8tnlsw-ip4base | 1.34 +- 0.31 | 1.3 +- 0.35 | -3.35 +- 34.74 | | 1518b-2t2c-ethip4udpwireguard2tnlsw-ip4base | 0.39 +- 0.18 | 0.34 +- 0.12 | -12.14 +- 50.75 | | 1518b-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.16 +- 0.03 | 0.13 +- 0.03 | -14.53 +- 27.32 | | imix-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 2.04 +- 0.38 | 1.71 +- 0.39 | -16.24 +- 24.86 | | imix-2t2c-ethip4udpwireguard1tnlsw-ip4base | 1.14 +- 0.49 | 0.93 +- 0.3 | -18.32 +- 44.3 | | imix-2t2c-ethip4udpwireguard2tnlsw-ip4base | 1.48 +- 0.0 | 1.15 +- 0.38 | -22.62 +- 25.93 | +------------------------------------------------------------------+---------------+---------------+------------------------+ Test Case: Test cases executed for: NDR throughput on 3n-snr with e822cq. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210 and rls2302). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2302.0-11 vs 2210.0-11: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.