+-----------------------------------------------------------------------+---------------+---------------+---------------+---------------+----------------------+----------------------+ | Test Case | 2106.0-8 | 2110.0-8 | 2110.0-9 | 2202.0-9 | 2110.0-9 vs 2110.0-8 | 2202.0-9 vs 2110.0-9 | +-----------------------------------------------------------------------+---------------+---------------+---------------+---------------+----------------------+----------------------+ | 78b-2t1c-avf-ethip6srhip6-ip6base-srv6proxy-masq | 7.62 +- 0.04 | 7.71 +- 0.05 | 7.7 +- 0.04 | 8.05 +- 0.02 | -0.2 +- 0.77 | +4.6 +- 0.56 | | imix-2t1c-avf-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 2.98 +- 0.45 | 2.73 +- 0.01 | 2.72 +- 0.01 | 2.83 +- 0.01 | -0.08 +- 0.56 | +3.86 +- 0.54 | | 78b-2t1c-avf-ethip6srhip6-ip6base-srv6proxy-dyn | 6.92 +- 0.08 | 7.01 +- 0.03 | 7.01 +- 0.08 | 7.25 +- 0.04 | -0.07 +- 1.2 | +3.47 +- 1.25 | | 1518b-2t1c-avf-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.67 +- 0.07 | 0.6 +- 0.0 | 0.6 +- 0.0 | 0.62 +- 0.0 | +0.18 +- 0.67 | +3.06 +- 0.74 | | 1518b-2t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 1.04 +- 0.01 | 1.05 +- 0.01 | 1.05 +- 0.01 | 1.08 +- 0.01 | -0.29 +- 0.98 | +2.87 +- 0.96 | | 1518b-2t1c-avf-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 1.18 +- 0.19 | 1.12 +- 0.0 | 1.12 +- 0.0 | 1.15 +- 0.0 | -0.02 +- 0.56 | +2.62 +- 0.54 | | imix-2t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 2.39 +- 0.01 | 2.41 +- 0.01 | 2.41 +- 0.01 | 2.47 +- 0.02 | +0.27 +- 0.76 | +2.18 +- 0.83 | | imix-2t1c-avf-ethip4ipsec40tnlsw-ip4base-int-aes256gcm | NT | 3.38 +- 0.01 | 3.38 +- 0.01 | 3.45 +- 0.01 | +0.06 +- 0.32 | +2.14 +- 0.3 | | imix-2t1c-ethip4ipsec40tnlsw-ip4base-int-aes256gcm | NT | 2.96 +- 0.01 | 2.97 +- 0.01 | 3.03 +- 0.01 | +0.28 +- 0.51 | +2.13 +- 0.46 | | 78b-2t1c-avf-ethip6srhip6-ip6base-srv6proxy-stat | 7.37 +- 0.07 | 7.42 +- 0.04 | 7.42 +- 0.06 | 7.55 +- 0.04 | +0.03 +- 0.96 | +1.83 +- 0.96 | | imix-2t1c-avf-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 1.47 +- 0.34 | 1.32 +- 0.01 | 1.32 +- 0.01 | 1.34 +- 0.01 | -0.15 +- 0.79 | +1.35 +- 0.58 | | imix-2t1c-avf-ethip4ipsec40tnlsw-ip4base-int-aes128cbc-hmac512sha | NT | 1.68 +- 0.0 | 1.68 +- 0.0 | 1.69 +- 0.0 | -0.0 +- 0.3 | +0.51 +- 0.29 | | 1518b-2t1c-avf-ethip4ipsec40tnlsw-ip4base-int-aes128cbc-hmac512sha | NT | 0.72 +- 0.0 | 0.72 +- 0.0 | 0.72 +- 0.0 | -0.22 +- 0.36 | +0.38 +- 0.41 | | 64b-2t1c-avf-eth-l2patch | 37.44 +- 0.09 | 37.32 +- 0.01 | 37.32 +- 0.03 | 37.33 +- 0.04 | +0.02 +- 0.07 | +0.02 +- 0.12 | | 64b-2t1c-avf-eth-l2xcbase | 37.5 +- 0.0 | 37.5 +- 0.0 | 37.5 +- 0.0 | 37.5 +- 0.0 | +0.0 +- 0.0 | +0.0 +- 0.0 | | 1518b-2t1c-ethip4ipsec40tnlsw-ip4base-int-aes256gcm | NT | 1.3 +- 0.0 | 1.3 +- 0.0 | 1.3 +- 0.01 | -0.01 +- 0.41 | -0.07 +- 0.51 | | 1518b-2t1c-avf-ethip4ipsec40tnlsw-ip4base-int-aes256gcm | NT | 1.39 +- 0.0 | 1.39 +- 0.0 | 1.39 +- 0.0 | -0.01 +- 0.3 | -0.21 +- 0.23 | | 1518b-2t1c-avf-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.71 +- 0.0 | 0.71 +- 0.0 | 0.71 +- 0.0 | 0.71 +- 0.0 | +0.0 +- 0.33 | -0.47 +- 0.3 | | imix-2t1c-avf-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 1.67 +- 0.0 | 1.66 +- 0.01 | 1.66 +- 0.0 | 1.65 +- 0.0 | -0.19 +- 0.47 | -0.64 +- 0.37 | | 64b-2t1c-avf-ethip4gtpusw-ip4base | 11.11 +- 0.22 | 11.01 +- 0.02 | 11.02 +- 0.02 | 10.91 +- 0.02 | +0.03 +- 0.21 | -1.0 +- 0.23 | | imix-2t1c-avf-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 3.1 +- 0.03 | 3.06 +- 0.01 | 3.06 +- 0.01 | 3.02 +- 0.01 | -0.14 +- 0.43 | -1.05 +- 0.47 | | 1518b-2t1c-avf-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.7 +- 0.0 | 0.69 +- 0.0 | 0.69 +- 0.0 | 0.68 +- 0.0 | -0.14 +- 0.6 | -1.05 +- 0.67 | | 78b-2t1c-avf-ethip6-ip6base | 19.47 +- 0.15 | 19.82 +- 0.12 | 19.77 +- 0.14 | 19.42 +- 0.05 | -0.23 +- 0.9 | -1.81 +- 0.72 | | imix-2t1c-avf-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 1.6 +- 0.01 | 1.59 +- 0.01 | 1.59 +- 0.01 | 1.55 +- 0.01 | -0.07 +- 0.9 | -2.3 +- 0.93 | | imix-2t1c-avf-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 2.8 +- 0.02 | 2.77 +- 0.01 | 2.75 +- 0.05 | 2.68 +- 0.02 | -0.77 +- 1.97 | -2.62 +- 2.08 | | 1518b-2t1c-avf-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 1.34 +- 0.0 | 1.33 +- 0.0 | 1.34 +- 0.0 | 1.3 +- 0.0 | +0.14 +- 0.31 | -2.65 +- 0.23 | | 1518b-2t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 1.13 +- 0.0 | 1.12 +- 0.0 | 1.12 +- 0.01 | 1.09 +- 0.01 | -0.25 +- 0.92 | -2.88 +- 0.98 | | imix-2t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 2.41 +- 0.02 | 2.39 +- 0.03 | 2.4 +- 0.03 | 2.31 +- 0.04 | +0.09 +- 1.79 | -3.43 +- 1.9 | | 64b-2t1c-avf-ethip4vxlan-l2xcbase | 15.41 +- 0.26 | 14.89 +- 0.02 | 14.91 +- 0.03 | 14.39 +- 0.02 | +0.12 +- 0.23 | -3.52 +- 0.22 | | 64b-2t1c-avf-ethip4-ip4base | 24.53 +- 0.04 | 24.14 +- 0.04 | 24.11 +- 0.05 | 23.11 +- 0.04 | -0.14 +- 0.26 | -4.16 +- 0.25 | | 1518b-2t1c-avf-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 1.27 +- 0.01 | 1.26 +- 0.01 | 1.26 +- 0.01 | 1.21 +- 0.01 | -0.01 +- 0.97 | -4.36 +- 0.77 | | 78b-2t1c-avf-ethip6ip6-ip6base-srv6enc1sid | 12.73 +- 0.06 | 12.86 +- 0.07 | 12.81 +- 0.09 | 12.18 +- 0.03 | -0.33 +- 0.88 | -4.92 +- 0.7 | | 64b-2t1c-avf-ethip4vxlan-l2bdbasemaclrn | 12.62 +- 0.33 | 12.25 +- 0.02 | 12.25 +- 0.02 | 11.64 +- 0.02 | -0.02 +- 0.23 | -5.03 +- 0.2 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 19.03 +- 0.04 | 19.13 +- 0.03 | 19.1 +- 0.02 | 18.13 +- 0.02 | -0.2 +- 0.17 | -5.07 +- 0.15 | | 78b-2t1c-avf-ethip6srhip6-ip6base-srv6enc2sids-nodecaps | 11.15 +- 0.03 | 11.23 +- 0.05 | 11.24 +- 0.09 | 10.62 +- 0.02 | +0.09 +- 0.94 | -5.49 +- 0.79 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 26.82 +- 0.06 | 26.2 +- 0.06 | 26.19 +- 0.03 | 24.38 +- 0.05 | -0.01 +- 0.27 | -6.94 +- 0.22 | | 64b-2t1c-ethip4-ip4base | 17.63 +- 0.09 | 17.12 +- 0.05 | 17.13 +- 0.05 | 15.31 +- 0.05 | +0.02 +- 0.45 | -10.63 +- 0.41 | | 78b-2t1c-avf-ethip6srhip6-ip6base-srv6enc2sids | 10.08 +- 1.55 | 10.66 +- 0.04 | 10.64 +- 0.02 | 9.46 +- 0.11 | -0.18 +- 0.42 | -11.09 +- 1.07 | | 78b-2t1c-ethip6-ip6base | 14.95 +- 0.13 | 15.39 +- 0.08 | 15.36 +- 0.11 | 13.57 +- 0.03 | -0.21 +- 0.91 | -11.63 +- 0.68 | | 64b-2t1c-eth-l2patch | 34.73 +- 0.04 | 34.49 +- 0.06 | 34.49 +- 0.07 | 29.96 +- 0.05 | -0.02 +- 0.25 | -13.12 +- 0.23 | | 64b-2t1c-ethip4gtpusw-ip4base | 9.68 +- 0.04 | 9.43 +- 0.03 | 9.45 +- 0.03 | 8.18 +- 0.01 | +0.28 +- 0.44 | -13.47 +- 0.33 | | 64b-2t1c-eth-l2bdbasemaclrn | 18.93 +- 0.14 | 18.52 +- 0.12 | 18.61 +- 0.16 | 15.89 +- 0.04 | +0.48 +- 1.08 | -14.64 +- 0.78 | | 64b-2t1c-eth-l2xcbase | 25.79 +- 0.09 | 25.5 +- 0.17 | 25.49 +- 0.18 | 21.63 +- 0.07 | -0.04 +- 0.96 | -15.16 +- 0.65 | | 64b-2t1c-ethip4vxlan-l2xcbase | 12.94 +- 0.04 | 12.7 +- 0.03 | 12.68 +- 0.06 | 10.07 +- 0.04 | -0.19 +- 0.54 | -20.56 +- 0.46 | | 64b-2t1c-ethip4vxlan-l2bdbasemaclrn | 10.98 +- 0.02 | 10.74 +- 0.02 | 10.73 +- 0.02 | 8.44 +- 0.02 | -0.04 +- 0.29 | -21.35 +- 0.23 | +-----------------------------------------------------------------------+---------------+---------------+---------------+---------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710. YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "8" for CSIT rls2110, "9" for CSIT rls2202). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2110.0-9 vs 2110.0-8: Compares CSIT environment current vs previous with previous VPP code. 2202.0-9 vs 2110.0-9: Compares VPP code current vs previous in the current CSIT environment.