+------------------------------------------------------------------+---------------+---------------+------------------------+ | Test Case | 2210.0-11 | 2302.0-11 | 2302.0-11 vs 2210.0-11 | +------------------------------------------------------------------+---------------+---------------+------------------------+ | 1518b-2t2c-ethip4udpwireguard4tnlsw-ip4base | 0.27 +- 0.0 | 0.49 +- 0.08 | +84.94 +- 30.04 | | 1518b-2t2c-ethip4udpwireguard1tnlsw-ip4base | 0.27 +- 0.0 | 0.35 +- 0.13 | +29.17 +- 47.13 | | 1518b-2t2c-ethip4udpwireguard8tnlsw-ip4base | 0.43 +- 0.14 | 0.52 +- 0.0 | +20.15 +- 39.61 | | imix-2t2c-ethip4udpwireguard4tnlsw-ip4base | 1.15 +- 0.51 | 1.38 +- 0.31 | +20.04 +- 59.41 | | 1518b-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 0.92 +- 0.24 | 0.96 +- 0.2 | +3.68 +- 34.08 | | 64b-2t2c-eth-l2xcbase | 15.93 +- 1.22 | 16.41 +- 0.04 | +3.03 +- 7.9 | | imix-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.43 +- 0.09 | 0.44 +- 0.11 | +2.94 +- 32.77 | | imix-2t2c-ethip4udpwireguard1000tnlsw-ip4base | 1.3 +- 0.0 | 1.32 +- NaN | +1.87 +- NaN | | imix-2t2c-ethip4udpwireguard100tnlsw-ip4base | 1.39 +- NaN | 1.42 +- 0.02 | +1.61 +- NaN | | 1518b-2t2c-ethip4udpwireguard100tnlsw-ip4base | 0.5 +- 0.01 | 0.5 +- 0.01 | +1.43 +- 2.16 | | imix-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.52 +- 0.0 | 0.52 +- 0.0 | +1.26 +- 0.34 | | 1518b-2t2c-ethip4udpwireguard1000tnlsw-ip4base | 0.46 +- 0.01 | 0.46 +- NaN | +0.98 +- NaN | | 64b-2t2c-eth-l2bdscale10kmaclrn | 11.65 +- 0.03 | 11.69 +- 0.04 | +0.3 +- 0.39 | | 78b-2t2c-ethip6-ip6base | 12.67 +- 0.03 | 12.69 +- 0.03 | +0.1 +- 0.31 | | 64b-2t2c-ethip4-ip4scale20k-rnd | 11.46 +- 0.03 | 11.47 +- 0.02 | +0.06 +- 0.3 | | 64b-2t2c-eth-l2bdbasemaclrn | 13.55 +- 0.04 | 13.54 +- 0.03 | -0.04 +- 0.35 | | 1518b-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.17 +- 0.0 | 0.17 +- 0.0 | -0.06 +- 0.23 | | 64b-2t2c-ethip4vxlan-l2xcbase | 10.1 +- 0.04 | 10.09 +- 0.04 | -0.1 +- 0.56 | | 78b-2t2c-ethip6-ip6scale20k-rnd | 9.98 +- 0.02 | 9.96 +- 0.06 | -0.11 +- 0.61 | | 78b-2t2c-ethip6-ip6scale20k | 9.67 +- 0.03 | 9.65 +- 0.04 | -0.12 +- 0.54 | | 64b-2t2c-ethip4-ip4base | 12.77 +- 0.04 | 12.74 +- 0.03 | -0.22 +- 0.36 | | 1518b-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 1.09 +- 0.0 | 1.08 +- 0.01 | -0.3 +- 0.64 | | 64b-2t2c-ethip4vxlan-l2bdbasemaclrn | 8.91 +- 0.03 | 8.88 +- 0.04 | -0.38 +- 0.6 | | 64b-2t2c-ethip4-ip4scale20k | 11.56 +- 0.07 | 11.51 +- 0.06 | -0.42 +- 0.75 | | imix-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 2.18 +- 0.01 | 2.16 +- 0.01 | -0.69 +- 0.87 | | 64b-2t2c-eth-l2patch | 22.56 +- 0.53 | 22.22 +- 0.37 | -1.5 +- 2.85 | | imix-2t2c-ethip4udpwireguard8tnlsw-ip4base | 1.36 +- 0.32 | 1.3 +- 0.35 | -4.35 +- 34.28 | | 1518b-2t2c-ethip4udpwireguard2tnlsw-ip4base | 0.39 +- 0.17 | 0.34 +- 0.12 | -12.09 +- 50.43 | | 1518b-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.16 +- 0.03 | 0.14 +- 0.03 | -14.58 +- 27.15 | | imix-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 2.06 +- 0.38 | 1.72 +- 0.39 | -16.25 +- 24.5 | | imix-2t2c-ethip4udpwireguard1tnlsw-ip4base | 1.15 +- 0.5 | 0.94 +- 0.31 | -18.12 +- 44.52 | | imix-2t2c-ethip4udpwireguard2tnlsw-ip4base | 1.5 +- 0.0 | 1.16 +- 0.39 | -22.68 +- 25.83 | +------------------------------------------------------------------+---------------+---------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 3n-snr with e822cq. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210 and rls2302). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2302.0-11 vs 2210.0-11: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.