+------------------------------------------------------------------+---------------+---------------+------------------------+ | Test Case | 2210.0-11 | 2302.0-11 | 2302.0-11 vs 2210.0-11 | +------------------------------------------------------------------+---------------+---------------+------------------------+ | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 5.61 +- 0.01 | 5.65 +- 0.01 | +0.61 +- 0.28 | | imix-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.27 +- 0.0 | 0.27 +- 0.0 | +0.55 +- 0.21 | | imix-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.27 +- 0.0 | 0.27 +- 0.0 | +0.45 +- 0.2 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 0.66 +- 0.0 | 0.66 +- 0.0 | +0.25 +- 0.44 | | 78b-1t1c-ethip6-ip6scale20k-rnd | 6.4 +- 0.01 | 6.42 +- 0.01 | +0.25 +- 0.24 | | 64b-1t1c-ethip4vxlan-l2xcbase | 6.58 +- 0.04 | 6.6 +- 0.02 | +0.22 +- 0.6 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.09 +- 0.0 | 0.09 +- 0.0 | +0.2 +- 0.19 | | 1518b-1t1c-ethip4udpwireguard2tnlsw-ip4base | 0.27 +- 0.0 | 0.27 +- 0.0 | +0.2 +- 0.2 | | 64b-1t1c-ethip4-ip4base | 9.12 +- 0.03 | 9.13 +- 0.03 | +0.15 +- 0.52 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.09 +- 0.0 | 0.09 +- 0.0 | +0.12 +- 0.2 | | 64b-1t1c-ethip4-ip4scale20k-rnd | 8.27 +- 0.03 | 8.28 +- 0.02 | +0.06 +- 0.46 | | 1518b-1t1c-ethip4udpwireguard4tnlsw-ip4base | 0.26 +- 0.0 | 0.27 +- 0.0 | +0.05 +- 0.25 | | 64b-1t1c-eth-l2bdscale10kmaclrn | 8.04 +- 0.01 | 8.05 +- 0.02 | +0.05 +- 0.33 | | 64b-1t1c-eth-l2bdbasemaclrn | 9.97 +- 0.03 | 9.97 +- 0.02 | +0.04 +- 0.41 | | 78b-1t1c-ethip6-ip6base | 8.42 +- 0.02 | 8.42 +- 0.03 | +0.03 +- 0.42 | | 64b-1t1c-ethip4-ip4scale20k | 8.61 +- 0.02 | 8.61 +- 0.06 | -0.02 +- 0.78 | | 64b-1t1c-eth-l2xcbase | 13.4 +- 0.05 | 13.39 +- 0.04 | -0.05 +- 0.47 | | 1518b-1t1c-ethip4udpwireguard1tnlsw-ip4base | 0.27 +- 0.0 | 0.27 +- 0.0 | -0.05 +- 0.2 | | 1518b-1t1c-ethip4udpwireguard8tnlsw-ip4base | 0.26 +- 0.0 | 0.26 +- 0.0 | -0.09 +- 0.24 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 0.62 +- 0.0 | 0.62 +- 0.0 | -0.13 +- 0.58 | | imix-1t1c-ethip4udpwireguard4tnlsw-ip4base | 0.79 +- 0.0 | 0.79 +- 0.0 | -0.16 +- 0.18 | | 1518b-1t1c-ethip4udpwireguard100tnlsw-ip4base | 0.26 +- 0.0 | 0.26 +- 0.0 | -0.22 +- 0.17 | | 78b-1t1c-ethip6-ip6scale20k | 6.28 +- 0.02 | 6.26 +- 0.01 | -0.26 +- 0.36 | | imix-1t1c-ethip4udpwireguard100tnlsw-ip4base | 0.74 +- 0.0 | 0.74 +- 0.0 | -0.27 +- 0.29 | | imix-1t1c-ethip4udpwireguard1tnlsw-ip4base | 0.8 +- 0.0 | 0.79 +- 0.0 | -0.34 +- 0.28 | | imix-1t1c-ethip4udpwireguard8tnlsw-ip4base | 0.79 +- 0.0 | 0.79 +- 0.0 | -0.35 +- 0.14 | | imix-1t1c-ethip4udpwireguard2tnlsw-ip4base | 0.79 +- 0.0 | 0.79 +- 0.0 | -0.46 +- 0.29 | | 64b-1t1c-eth-l2patch | 19.78 +- 0.11 | 19.68 +- 0.09 | -0.47 +- 0.72 | | imix-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 1.26 +- 0.0 | 1.26 +- 0.01 | -0.48 +- 0.59 | | imix-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 1.17 +- 0.01 | 1.16 +- 0.01 | -0.94 +- 0.83 | | imix-1t1c-ethip4udpwireguard1000tnlsw-ip4base | 0.71 +- 0.0 | 0.69 +- 0.01 | -2.02 +- 1.05 | +------------------------------------------------------------------+---------------+---------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 3n-snr with e822cq. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210 and rls2302). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2302.0-11 vs 2210.0-11: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.