+------------------------------------------------------------------+---------------+---------------+--------------+------------------------+ | Test Case | 2202.0-10 | 2206.0-10 | 2210.0-11 | 2210.0-11 vs 2206.0-10 | +------------------------------------------------------------------+---------------+---------------+--------------+------------------------+ | 1518b-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 0.34 +- 0.22 | 0.37 +- 0.2 | 0.44 +- 0.17 | +19.85 +- 80.63 | | 78b-2t2c-ethip6-ip6scale20k | 4.09 +- 0.17 | 3.48 +- 0.79 | 4.07 +- 0.14 | +16.92 +- 26.85 | | 64b-2t2c-eth-l2bdbasemaclrn | 6.44 +- 2.69 | 6.15 +- 2.91 | 6.92 +- 2.44 | +12.49 +- 66.33 | | 78b-2t2c-ethip6-ip6base | 5.83 +- 2.24 | 5.19 +- 2.48 | 5.65 +- 2.33 | +8.89 +- 68.65 | | 78b-2t2c-ethip6-ip6scale20k-rnd | 3.55 +- 0.49 | 3.33 +- 0.59 | 3.4 +- 0.58 | +2.18 +- 25.16 | | 64b-2t2c-eth-l2xcbase | 7.77 +- 3.6 | 9.06 +- 2.99 | 9.15 +- 3.03 | +1.06 +- 47.23 | | imix-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.34 +- 0.0 | 0.34 +- 0.0 | 0.34 +- 0.0 | +0.39 +- 0.5 | | 1518b-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.13 +- 0.0 | 0.13 +- 0.0 | 0.13 +- 0.0 | +0.15 +- 0.27 | | 1518b-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.12 +- 0.0 | 0.12 +- 0.0 | 0.12 +- 0.0 | +0.09 +- 0.69 | | imix-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.38 +- 0.0 | 0.38 +- 0.0 | 0.38 +- 0.0 | +0.02 +- 0.34 | | 64b-2t2c-ethip4-ip4scale20k-rnd | 5.2 +- 0.9 | 5.15 +- 0.97 | 5.12 +- 1.05 | -0.71 +- 27.63 | | 64b-2t2c-ethip4vxlan-l2bdbasemaclrn | 4.47 +- 1.48 | 4.48 +- 1.48 | 4.26 +- 1.64 | -4.89 +- 48.26 | | 64b-2t2c-eth-l2patch | 12.27 +- 3.5 | 12.28 +- 4.11 | 11.6 +- 4.91 | -5.46 +- 50.99 | | imix-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 0.88 +- 0.25 | 1.06 +- 0.0 | 1.0 +- 0.17 | -5.55 +- 16.0 | | 1518b-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 0.5 +- 0.24 | 0.58 +- 0.19 | 0.52 +- 0.23 | -9.28 +- 48.9 | | 64b-2t2c-ethip4vxlan-l2xcbase | 4.8 +- 2.01 | 4.75 +- 1.99 | 4.23 +- 2.21 | -11.0 +- 59.72 | | imix-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 1.34 +- 0.37 | 1.33 +- 0.37 | 1.18 +- 0.45 | -11.03 +- 41.84 | | 64b-2t2c-ethip4-ip4scale20k | 5.22 +- 1.54 | 5.83 +- 1.02 | 5.15 +- 1.64 | -11.75 +- 32.16 | | 64b-2t2c-ethip4-ip4base | 6.88 +- 1.92 | 7.18 +- 1.58 | 5.7 +- 2.55 | -20.7 +- 39.59 | | 64b-2t2c-eth-l2bdscale10kmaclrn | 4.79 +- 0.74 | 4.82 +- 0.7 | 3.3 +- 0.81 | -31.68 +- 19.51 | +------------------------------------------------------------------+---------------+---------------+--------------+------------------------+ Test Case: Test cases executed for: NDR throughput on 3n-dnv with x553. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2210.0-11 vs 2206.0-10: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.