+-----------------------------------------------------------------------+---------------+---------------+---------------+---------------+----------------------+----------------------+ | Test Case | 2106.0-8 | 2110.0-8 | 2110.0-9 | 2202.0-9 | 2110.0-9 vs 2110.0-8 | 2202.0-9 vs 2110.0-9 | +-----------------------------------------------------------------------+---------------+---------------+---------------+---------------+----------------------+----------------------+ | 1518b-2t1c-avf-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.58 +- 0.01 | 0.58 +- 0.02 | 0.57 +- 0.01 | 0.59 +- 0.01 | -1.92 +- 3.01 | +3.12 +- 2.61 | | 78b-2t1c-avf-ethip6srhip6-ip6base-srv6proxy-masq | 7.62 +- 0.02 | 7.58 +- 0.04 | 7.59 +- 0.07 | 7.7 +- 0.06 | +0.07 +- 1.05 | +1.55 +- 1.24 | | imix-2t1c-avf-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 1.84 +- 0.0 | 1.39 +- 0.0 | 1.39 +- 0.0 | 1.4 +- 0.0 | +0.02 +- 0.22 | +0.37 +- 0.35 | | 64b-2t1c-avf-eth-l2xcbase | 37.36 +- 0.02 | 37.3 +- 0.23 | 37.33 +- 0.15 | 37.37 +- 0.02 | +0.08 +- 0.75 | +0.11 +- 0.42 | | 78b-2t1c-avf-ethip6srhip6-ip6base-srv6proxy-dyn | 6.9 +- 0.02 | 6.88 +- 0.02 | 6.75 +- 0.02 | 6.75 +- 0.03 | -1.81 +- 0.47 | -0.07 +- 0.62 | | 64b-2t1c-avf-eth-l2patch | 37.11 +- 0.07 | 36.84 +- 0.06 | 36.85 +- 0.04 | 36.81 +- 0.03 | +0.04 +- 0.19 | -0.11 +- 0.15 | | 64b-2t1c-avf-ethip4gtpusw-ip4base | NT | 11.04 +- 0.05 | 11.04 +- 0.06 | 10.99 +- 0.1 | -0.03 +- 0.73 | -0.47 +- 1.08 | | imix-2t1c-avf-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 2.74 +- 0.0 | 2.85 +- 0.02 | 2.85 +- 0.01 | 2.83 +- 0.0 | -0.31 +- 0.61 | -0.49 +- 0.27 | | 1518b-2t1c-avf-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.71 +- 0.0 | 0.71 +- 0.0 | 0.71 +- 0.0 | 0.7 +- 0.0 | +0.21 +- 0.81 | -0.75 +- 0.83 | | 78b-2t1c-avf-ethip6-ip6base | 19.44 +- 0.1 | 19.75 +- 0.1 | 19.69 +- 0.08 | 19.55 +- 0.08 | -0.29 +- 0.64 | -0.75 +- 0.6 | | imix-2t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 2.52 +- 0.0 | 2.51 +- 0.0 | 2.5 +- 0.01 | 2.49 +- 0.0 | -0.36 +- 0.54 | -0.75 +- 0.55 | | 78b-2t1c-avf-ethip6srhip6-ip6base-srv6proxy-stat | 7.34 +- 0.05 | 7.31 +- 0.05 | 7.28 +- 0.04 | 7.21 +- 0.06 | -0.37 +- 0.91 | -0.9 +- 0.92 | | imix-2t1c-avf-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 1.68 +- 0.0 | 1.66 +- 0.0 | 1.67 +- 0.0 | 1.65 +- 0.0 | +0.22 +- 0.23 | -1.11 +- 0.17 | | 1518b-2t1c-avf-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.7 +- 0.0 | 0.69 +- 0.0 | 0.7 +- 0.01 | 0.69 +- 0.01 | +0.71 +- 1.08 | -1.17 +- 1.53 | | imix-2t1c-avf-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 3.08 +- 0.0 | 3.05 +- 0.01 | 3.07 +- 0.0 | 3.02 +- 0.0 | +0.41 +- 0.26 | -1.45 +- 0.18 | | 1518b-2t1c-avf-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 1.35 +- 0.01 | 1.34 +- 0.01 | 1.34 +- 0.01 | 1.31 +- 0.01 | -0.4 +- 0.9 | -2.13 +- 0.88 | | 1518b-2t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 1.07 +- 0.01 | 1.06 +- 0.01 | 1.07 +- 0.01 | 1.04 +- 0.02 | +0.33 +- 0.94 | -2.3 +- 1.6 | | imix-2t1c-avf-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 1.62 +- 0.01 | 1.6 +- 0.01 | 1.6 +- 0.01 | 1.56 +- 0.01 | -0.39 +- 0.64 | -2.34 +- 0.55 | | imix-2t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 2.45 +- 0.01 | 2.42 +- 0.02 | 2.43 +- 0.02 | 2.35 +- 0.01 | +0.53 +- 0.94 | -3.27 +- 0.86 | | 78b-2t1c-avf-ethip6ip6-ip6base-srv6enc1sid | 12.66 +- 0.06 | 12.69 +- 0.07 | 12.62 +- 0.05 | 12.2 +- 0.13 | -0.48 +- 0.65 | -3.36 +- 1.1 | | 1518b-2t1c-avf-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 1.39 +- 0.01 | 1.11 +- 0.01 | 1.12 +- 0.01 | 1.08 +- 0.01 | +0.35 +- 0.94 | -3.4 +- 0.93 | | 78b-2t1c-avf-ethip6srhip6-ip6base-srv6enc2sids-nodecaps | 11.2 +- 0.04 | 11.19 +- 0.04 | 10.97 +- 0.05 | 10.57 +- 0.05 | -1.94 +- 0.53 | -3.7 +- 0.6 | | 64b-2t1c-avf-ethip4-ip4base | 24.59 +- 0.09 | 24.17 +- 0.07 | 24.14 +- 0.16 | 23.16 +- 0.1 | -0.15 +- 0.71 | -4.05 +- 0.76 | | 64b-2t1c-avf-ethip4vxlan-l2xcbase | 15.63 +- 0.05 | 14.98 +- 0.07 | 15.03 +- 0.07 | 14.38 +- 0.06 | +0.32 +- 0.65 | -4.31 +- 0.59 | | 1518b-2t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 1.14 +- 0.01 | 1.1 +- 0.01 | 1.12 +- 0.01 | 1.06 +- 0.01 | +1.33 +- 1.31 | -4.98 +- 1.25 | | 1518b-2t1c-avf-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 1.28 +- 0.01 | 1.28 +- 0.01 | 1.28 +- 0.02 | 1.22 +- 0.01 | +0.61 +- 1.52 | -5.13 +- 1.53 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 19.48 +- 0.18 | 19.82 +- 0.18 | 19.82 +- 0.12 | 18.78 +- 0.14 | +0.0 +- 1.08 | -5.26 +- 0.92 | | 64b-2t1c-avf-ethip4vxlan-l2bdbasemaclrn | 12.95 +- 0.1 | 12.34 +- 0.08 | 12.4 +- 0.03 | 11.74 +- 0.05 | +0.44 +- 0.71 | -5.29 +- 0.48 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 27.16 +- 0.15 | 26.23 +- 0.08 | 26.24 +- 0.12 | 24.51 +- 0.07 | +0.04 +- 0.56 | -6.59 +- 0.51 | | imix-2t1c-avf-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 2.82 +- 0.01 | 2.77 +- 0.01 | 2.81 +- 0.01 | 2.59 +- 0.01 | +1.55 +- 0.47 | -7.95 +- 0.43 | | 64b-2t1c-eth-l2patch | 34.66 +- 0.05 | 34.48 +- 0.05 | 34.4 +- 0.06 | 31.56 +- 0.08 | -0.23 +- 0.23 | -8.28 +- 0.28 | | 64b-2t1c-eth-l2xcbase | 26.05 +- 0.08 | 25.71 +- 0.06 | 25.58 +- 0.06 | 23.36 +- 0.1 | -0.49 +- 0.35 | -8.7 +- 0.45 | | 64b-2t1c-ethip4-ip4base | 18.58 +- 0.08 | 17.92 +- 0.32 | 17.73 +- 0.14 | 16.16 +- 0.1 | -1.07 +- 1.95 | -8.81 +- 0.93 | | 78b-2t1c-avf-ethip6srhip6-ip6base-srv6enc2sids | 10.64 +- 0.04 | 10.48 +- 0.11 | 10.53 +- 0.04 | 9.47 +- 0.05 | +0.48 +- 1.15 | -10.12 +- 0.57 | | 64b-2t1c-ethip4gtpusw-ip4base | NT | 9.38 +- 0.06 | 9.43 +- 0.06 | 8.44 +- 0.04 | +0.45 +- 0.94 | -10.46 +- 0.72 | | 78b-2t1c-ethip6-ip6base | 14.63 +- 0.1 | 16.19 +- 0.08 | 15.96 +- 0.08 | 14.15 +- 0.05 | -1.43 +- 0.69 | -11.35 +- 0.52 | | 64b-2t1c-eth-l2bdbasemaclrn | 19.81 +- 0.1 | 19.47 +- 0.16 | 19.69 +- 0.12 | 16.94 +- 0.08 | +1.16 +- 1.02 | -13.96 +- 0.66 | | 64b-2t1c-ethip4vxlan-l2xcbase | 12.61 +- 0.07 | 12.32 +- 0.07 | 12.27 +- 0.07 | 10.53 +- 0.05 | -0.43 +- 0.79 | -14.22 +- 0.65 | | 64b-2t1c-ethip4vxlan-l2bdbasemaclrn | 10.72 +- 0.06 | 10.46 +- 0.05 | 10.44 +- 0.04 | 8.79 +- 0.04 | -0.18 +- 0.62 | -15.8 +- 0.46 | +-----------------------------------------------------------------------+---------------+---------------+---------------+---------------+----------------------+----------------------+ Test Case: Test cases executed for: MRR throughput on 3n-skx with xxv710. YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "8" for CSIT rls2110, "9" for CSIT rls2202). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2110.0-9 vs 2110.0-8: Compares CSIT environment current vs previous with previous VPP code. 2202.0-9 vs 2110.0-9: Compares VPP code current vs previous in the current CSIT environment.