+------------------------------------------------------------------------+---------------+---------------+---------------+---------------+----------------------+----------------------+ | Test Case | 2106.0-8 | 2110.0-8 | 2110.0-9 | 2202.0-9 | 2110.0-9 vs 2110.0-8 | 2202.0-9 vs 2110.0-9 | +------------------------------------------------------------------------+---------------+---------------+---------------+---------------+----------------------+----------------------+ | 64b-2t2c-af-xdp-eth-l2xcbase | 1.57 +- 0.02 | 1.53 +- 0.0 | 1.54 +- 0.01 | 1.62 +- 0.01 | +0.5 +- 0.64 | +5.41 +- 1.09 | | imix-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm-udir | 2.16 +- 0.0 | 2.14 +- 0.0 | 2.14 +- 0.0 | 2.23 +- 0.0 | -0.03 +- 0.15 | +3.95 +- 0.15 | | imix-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm-udir | 2.19 +- 0.0 | 2.17 +- 0.0 | 2.17 +- 0.0 | 2.26 +- 0.0 | -0.13 +- 0.15 | +3.95 +- 0.16 | | 64b-2t2c-af-xdp-eth-l2patch | 2.34 +- 0.01 | 2.35 +- 0.02 | 2.34 +- 0.01 | 2.4 +- 0.01 | -0.74 +- 0.78 | +2.57 +- 0.55 | | 64b-2t2c-af-xdp-ethip4-ip4scale20k | 0.89 +- 0.01 | 0.87 +- 0.01 | 0.86 +- 0.01 | 0.88 +- 0.01 | -1.29 +- 1.32 | +2.34 +- 1.37 | | 64b-2t2c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm-udir | 2.13 +- 0.0 | 2.22 +- 0.0 | 2.22 +- 0.01 | 2.27 +- 0.0 | -0.3 +- 0.3 | +2.24 +- 0.28 | | 64b-2t2c-eth-l2xcbase-eth-2memif-1dcr | 10.71 +- 0.05 | 10.52 +- 0.08 | 10.53 +- 0.08 | 10.68 +- 0.03 | +0.06 +- 1.03 | +1.38 +- 0.79 | | 64b-2t2c-af-xdp-ethip4-ip4base | 0.96 +- 0.01 | 0.93 +- 0.01 | 0.93 +- 0.01 | 0.94 +- 0.01 | -0.33 +- 1.68 | +1.3 +- 1.21 | | imix-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm-udir | 2.42 +- 0.0 | 2.41 +- 0.0 | 2.41 +- 0.01 | 2.43 +- 0.0 | -0.05 +- 0.28 | +1.14 +- 0.27 | | 64b-2t2c-af-xdp-eth-l2bdbasemaclrn | 1.07 +- 0.01 | 1.07 +- 0.01 | 1.06 +- 0.01 | 1.07 +- 0.01 | -0.62 +- 1.02 | +0.88 +- 1.34 | | 64b-2t2c-af-xdp-eth-l2bdscale100kmaclrn | 0.83 +- 0.0 | 0.83 +- 0.0 | 0.83 +- 0.0 | 0.83 +- 0.0 | -0.07 +- 0.2 | +0.85 +- 0.16 | | imix-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm-udir | 2.56 +- 0.0 | 2.55 +- 0.0 | 2.55 +- 0.0 | 2.56 +- 0.0 | -0.02 +- 0.13 | +0.46 +- 0.09 | | imix-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm-udir | 2.61 +- 0.0 | 2.59 +- 0.0 | 2.59 +- 0.0 | 2.6 +- 0.0 | -0.02 +- 0.13 | +0.42 +- 0.16 | | 64b-2t2c-af-xdp-eth-l2bdscale10kmaclrn | 0.86 +- 0.0 | 0.85 +- 0.0 | 0.85 +- 0.0 | 0.86 +- 0.0 | +0.23 +- 0.38 | +0.41 +- 0.4 | | 64b-2t2c-af-xdp-ethip4-ip4scale200k | 0.85 +- 0.01 | 0.83 +- 0.01 | 0.84 +- 0.01 | 0.84 +- 0.01 | +0.8 +- 1.22 | +0.41 +- 1.49 | | 1518b-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | 0.22 +- 0.0 | 0.22 +- 0.0 | 0.22 +- 0.0 | 0.22 +- 0.0 | -0.01 +- 0.77 | -0.75 +- 0.72 | | 1518b-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | 0.22 +- 0.0 | 0.22 +- 0.0 | 0.22 +- 0.0 | 0.22 +- 0.0 | -0.06 +- 0.49 | -0.78 +- 0.69 | | 1518b-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm-udir | 0.79 +- 0.0 | 0.79 +- 0.0 | 0.79 +- 0.0 | 0.78 +- 0.0 | +0.12 +- 0.72 | -0.82 +- 0.58 | | 1518b-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | 0.22 +- 0.0 | 0.22 +- 0.0 | 0.22 +- 0.0 | 0.22 +- 0.0 | +0.0 +- 0.51 | -0.89 +- 0.55 | | 1518b-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm-udir | 0.8 +- 0.0 | 0.79 +- 0.0 | 0.79 +- 0.0 | 0.79 +- 0.0 | +0.02 +- 0.63 | -0.9 +- 0.62 | | imix-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | 0.5 +- 0.0 | 0.5 +- 0.0 | 0.5 +- 0.0 | 0.5 +- 0.0 | -0.17 +- 0.11 | -1.25 +- 0.11 | | imix-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm-udir | 2.94 +- 0.0 | 2.91 +- 0.0 | 2.92 +- 0.0 | 2.88 +- 0.0 | +0.2 +- 0.18 | -1.31 +- 0.16 | | imix-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | 0.48 +- 0.0 | 0.48 +- 0.0 | 0.48 +- 0.0 | 0.48 +- 0.0 | -0.09 +- 0.13 | -1.43 +- 0.12 | | imix-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | 0.49 +- 0.0 | 0.49 +- 0.0 | 0.49 +- 0.0 | 0.48 +- 0.0 | -0.0 +- 0.09 | -1.55 +- 0.08 | | 78b-2t2c-af-xdp-ethip6-ip6scale20k | 0.74 +- 0.01 | 0.73 +- 0.0 | 0.73 +- 0.0 | 0.72 +- 0.01 | -0.61 +- 0.75 | -1.59 +- 0.96 | | 64b-2t2c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 8.76 +- 0.05 | 8.67 +- 0.07 | 8.68 +- 0.07 | 8.52 +- 0.05 | +0.14 +- 1.18 | -1.82 +- 0.99 | | 78b-2t2c-af-xdp-ethip6-ip6scale200k | 0.59 +- 0.0 | 0.59 +- 0.0 | 0.58 +- 0.0 | 0.57 +- 0.0 | -1.66 +- 0.76 | -2.11 +- 0.47 | | 1518b-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm-udir | 1.04 +- 0.0 | 1.04 +- 0.0 | 1.04 +- 0.01 | 1.02 +- 0.0 | -0.11 +- 0.62 | -2.12 +- 0.66 | | 1518b-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm-udir | 0.83 +- 0.0 | 0.82 +- 0.0 | 0.82 +- 0.0 | 0.8 +- 0.0 | -0.23 +- 0.57 | -2.23 +- 0.72 | | 1518b-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm-udir | 1.04 +- 0.0 | 1.04 +- 0.01 | 1.04 +- 0.0 | 1.02 +- 0.01 | +0.36 +- 0.7 | -2.41 +- 0.69 | | 78b-2t2c-af-xdp-ethip6-ip6base | 0.9 +- 0.01 | 0.88 +- 0.0 | 0.89 +- 0.01 | 0.86 +- 0.01 | +0.98 +- 1.06 | -2.53 +- 1.55 | | 1518b-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm-udir | 1.1 +- 0.0 | 1.09 +- 0.0 | 1.09 +- 0.0 | 1.06 +- 0.0 | -0.04 +- 0.46 | -3.27 +- 0.44 | | 64b-2t2c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 6.25 +- 0.02 | 6.59 +- 0.12 | 6.27 +- 0.14 | 6.02 +- 0.02 | -4.98 +- 2.79 | -3.94 +- 2.23 | | 64b-2t2c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm-udir | 3.62 +- 0.01 | 3.78 +- 0.0 | 3.79 +- 0.02 | 3.62 +- 0.02 | +0.22 +- 0.49 | -4.41 +- 0.72 | | 64b-2t2c-ethip4-ip4base-eth-2memif-1dcr | 7.92 +- 0.06 | 7.72 +- 0.05 | 7.8 +- 0.06 | 7.42 +- 0.03 | +0.98 +- 1.0 | -4.85 +- 0.84 | | 64b-2t2c-eth-l2patch | 37.28 +- 0.03 | 37.27 +- 0.02 | 37.36 +- 0.04 | 32.74 +- 0.08 | +0.24 +- 0.12 | -12.38 +- 0.23 | | 64b-2t2c-eth-l2bdscale10kmaclrn | 17.33 +- 0.08 | 16.69 +- 0.04 | 16.66 +- 0.04 | 14.42 +- 0.07 | -0.13 +- 0.36 | -13.48 +- 0.48 | | 64b-2t2c-ethip4udp-ip4base-oacl50sl-10kflows | 10.27 +- 0.33 | 9.93 +- 0.12 | 9.87 +- 0.04 | 8.54 +- 0.08 | -0.57 +- 1.31 | -13.51 +- 0.84 | | 64b-2t2c-eth-l2xcbase | 28.8 +- 0.08 | 27.48 +- 0.07 | 27.67 +- 0.07 | 23.9 +- 0.09 | +0.7 +- 0.36 | -13.62 +- 0.4 | | 64b-2t2c-ethip4-ip4base-iacldstbase | 13.3 +- 0.1 | 13.9 +- 0.11 | 12.86 +- 0.21 | 11.1 +- 0.06 | -7.47 +- 1.7 | -13.65 +- 1.5 | | 64b-2t2c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 10.03 +- 0.15 | 9.82 +- 0.13 | 9.67 +- 0.1 | 8.34 +- 0.05 | -1.55 +- 1.67 | -13.72 +- 1.04 | | 64b-2t2c-eth-l2bdscale100kmaclrn | 16.28 +- 0.03 | 15.75 +- 0.01 | 15.81 +- 0.03 | 13.58 +- 0.03 | +0.38 +- 0.19 | -14.11 +- 0.26 | | 64b-2t2c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 10.26 +- 0.25 | 10.04 +- 0.18 | 10.22 +- 0.05 | 8.63 +- 0.06 | +1.81 +- 1.91 | -15.55 +- 0.71 | | 78b-2t2c-ethip6-ip6scale20k | 14.24 +- 0.11 | 13.74 +- 0.08 | 13.7 +- 0.07 | 11.53 +- 0.07 | -0.27 +- 0.79 | -15.89 +- 0.69 | | 64b-2t2c-ethip4-ip4scale200k | 17.01 +- 0.15 | 16.39 +- 0.16 | 16.3 +- 0.1 | 13.68 +- 0.11 | -0.54 +- 1.14 | -16.11 +- 0.82 | | 64b-2t2c-eth-l2bdbasemaclrn | 22.45 +- 0.09 | 21.7 +- 0.06 | 21.87 +- 0.13 | 18.33 +- 0.11 | +0.78 +- 0.68 | -16.17 +- 0.71 | | 64b-2t2c-ethip4udp-ip4base-iacl50sl-10kflows | 10.92 +- 0.27 | 10.29 +- 0.22 | 10.26 +- 0.11 | 8.59 +- 0.05 | -0.35 +- 2.43 | -16.19 +- 1.06 | | 78b-2t2c-ethip6-ip6base | 18.14 +- 0.12 | 17.8 +- 0.13 | 17.7 +- 0.14 | 14.81 +- 0.06 | -0.56 +- 1.07 | -16.32 +- 0.75 | | 64b-2t2c-dot1q-l2bdbasemaclrn | 15.78 +- 0.09 | 15.37 +- 0.1 | 15.36 +- 0.07 | 12.79 +- 0.08 | -0.1 +- 0.77 | -16.74 +- 0.67 | | 64b-2t2c-ethip4-ip4base | 20.75 +- 0.08 | 19.72 +- 0.11 | 19.79 +- 0.1 | 16.29 +- 0.1 | +0.38 +- 0.72 | -17.69 +- 0.64 | | 78b-2t2c-ethip6-ip6scale200k | 10.74 +- 0.04 | 10.44 +- 0.05 | 10.51 +- 0.08 | 8.65 +- 0.04 | +0.6 +- 0.88 | -17.69 +- 0.72 | | 64b-2t2c-ethip4-ip4scale20k | 18.77 +- 0.1 | 17.86 +- 0.13 | 18.03 +- 0.08 | 14.72 +- 0.14 | +0.96 +- 0.86 | -18.35 +- 0.86 | | 64b-2t2c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 12.63 +- 0.06 | 12.07 +- 0.07 | 11.97 +- 0.09 | 9.77 +- 0.07 | -0.8 +- 0.9 | -18.44 +- 0.84 | | 78b-2t2c-ethip6-ip6base-iacldstbase | 10.97 +- 0.06 | 12.96 +- 0.22 | 13.02 +- 0.14 | 10.59 +- 0.04 | +0.47 +- 2.07 | -18.62 +- 0.95 | | 64b-2t2c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm-udir | 0.9 +- 0.0 | 0.9 +- 0.01 | 0.9 +- 0.0 | 0.73 +- 0.01 | -0.15 +- 0.79 | -18.81 +- 0.72 | | 64b-2t2c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 12.18 +- 0.06 | 11.53 +- 0.08 | 11.56 +- 0.07 | 9.35 +- 0.08 | +0.28 +- 0.94 | -19.1 +- 0.82 | | 64b-2t2c-ethip4udp-ip4base-oacl50sf-10kflows | 12.79 +- 0.06 | 11.92 +- 0.08 | 11.95 +- 0.07 | 9.65 +- 0.07 | +0.26 +- 0.89 | -19.29 +- 0.77 | | 64b-2t2c-ethip4udp-ip4base-iacl50sf-10kflows | 13.27 +- 0.07 | 12.33 +- 0.07 | 12.34 +- 0.06 | 9.76 +- 0.04 | +0.07 +- 0.8 | -20.88 +- 0.5 | +------------------------------------------------------------------------+---------------+---------------+---------------+---------------+----------------------+----------------------+ Test Case: Test cases executed for: MRR throughput on 2n-tx2 with xl710. YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "8" for CSIT rls2110, "9" for CSIT rls2202). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2110.0-9 vs 2110.0-8: Compares CSIT environment current vs previous with previous VPP code. 2202.0-9 vs 2110.0-9: Compares VPP code current vs previous in the current CSIT environment.