+-----------------------------------------------------------------------+---------------+---------------+---------------+---------------+----------------------+----------------------+ | Test Case | 2106.0-8 | 2110.0-8 | 2110.0-9 | 2202.0-9 | 2110.0-9 vs 2110.0-8 | 2202.0-9 vs 2110.0-9 | +-----------------------------------------------------------------------+---------------+---------------+---------------+---------------+----------------------+----------------------+ | 78b-4t4c-af-xdp-ethip6-ip6base | 1.78 +- 0.02 | 1.33 +- 0.02 | 1.33 +- 0.01 | 2.01 +- 0.01 | -0.25 +- 1.53 | +51.33 +- 1.74 | | 64b-4t4c-af-xdp-ethip4-ip4scale200k | 1.55 +- 0.02 | 1.52 +- 0.01 | 1.52 +- 0.02 | 2.02 +- 0.02 | -0.13 +- 1.34 | +32.9 +- 1.88 | | 64b-4t4c-eth-l2xcbase-eth-2memif-1dcr | 15.3 +- 0.11 | 14.71 +- 0.07 | 14.76 +- 0.03 | 18.54 +- 0.13 | +0.3 +- 0.49 | +25.65 +- 0.88 | | 64b-4t4c-ethip4udp-ip4base-oacl50sl-10kflows | 15.15 +- 0.16 | 13.6 +- 0.19 | 13.87 +- 0.1 | 16.56 +- 0.07 | +1.99 +- 1.59 | +19.39 +- 1.02 | | 64b-4t4c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 15.45 +- 0.36 | 13.44 +- 0.21 | 13.84 +- 0.15 | 16.29 +- 0.08 | +3.0 +- 1.93 | +17.63 +- 1.39 | | 64b-4t4c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 15.99 +- 0.22 | 15.58 +- 0.18 | 14.71 +- 0.31 | 17.03 +- 0.09 | -5.58 +- 2.25 | +15.75 +- 2.51 | | 64b-4t4c-ethip4-ip4base-eth-2memif-1dcr | 12.19 +- 0.17 | 11.49 +- 0.13 | 11.47 +- 0.14 | 13.2 +- 0.1 | -0.19 +- 1.67 | +15.03 +- 1.62 | | 64b-4t4c-ethip4udp-ip4base-iacl50sl-10kflows | 15.46 +- 0.28 | 17.01 +- 0.16 | 14.63 +- 0.13 | 16.66 +- 0.1 | -14.01 +- 1.12 | +13.93 +- 1.24 | | 64b-4t4c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 13.86 +- 0.05 | 13.46 +- 0.07 | 13.48 +- 0.11 | 15.3 +- 0.11 | +0.19 +- 0.95 | +13.46 +- 1.22 | | 64b-4t4c-eth-l2bdscale100kmaclrn | 25.45 +- 0.04 | 24.27 +- 0.12 | 24.19 +- 0.06 | 26.81 +- 0.06 | -0.31 +- 0.55 | +10.81 +- 0.37 | | 78b-4t4c-ethip6-ip6scale20k | 20.51 +- 0.08 | 19.53 +- 0.09 | 19.52 +- 0.08 | 21.61 +- 0.09 | -0.09 +- 0.62 | +10.74 +- 0.67 | | 64b-4t4c-ethip4-ip4scale200k | 24.99 +- 0.07 | 23.79 +- 0.08 | 23.64 +- 0.17 | 25.63 +- 0.05 | -0.61 +- 0.79 | +8.41 +- 0.8 | | 64b-4t4c-ethip4-ip4scale20k | 28.54 +- 0.14 | 27.31 +- 0.1 | 27.3 +- 0.08 | 29.38 +- 0.21 | -0.05 +- 0.48 | +7.63 +- 0.84 | | 64b-4t4c-eth-l2bdscale10kmaclrn | 28.68 +- 0.2 | 27.19 +- 0.05 | 27.15 +- 0.15 | 28.94 +- 0.11 | -0.14 +- 0.57 | +6.6 +- 0.72 | | 64b-4t4c-ethip4-ip4base | 32.55 +- 0.08 | 31.25 +- 0.06 | 31.23 +- 0.06 | 32.66 +- 0.07 | -0.05 +- 0.27 | +4.58 +- 0.31 | | 64b-4t4c-af-xdp-eth-l2xcbase | 3.22 +- 0.01 | 3.07 +- 0.02 | 3.14 +- 0.02 | 3.27 +- 0.03 | +2.27 +- 1.05 | +4.31 +- 1.19 | | imix-4t4c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm-udir | 4.39 +- 0.0 | 4.35 +- 0.0 | 4.35 +- 0.0 | 4.53 +- 0.01 | +0.01 +- 0.14 | +4.21 +- 0.17 | | imix-4t4c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm-udir | 3.95 +- 0.01 | 3.89 +- 0.01 | 3.91 +- 0.0 | 4.06 +- 0.01 | +0.71 +- 0.28 | +3.75 +- 0.2 | | 78b-4t4c-ethip6-ip6base-iacldstbase | 18.25 +- 0.2 | 19.46 +- 0.14 | 19.51 +- 0.11 | 20.23 +- 0.09 | +0.23 +- 0.89 | +3.73 +- 0.74 | | 64b-4t4c-eth-l2bdbasemaclrn | 36.0 +- 0.49 | 34.26 +- 0.08 | 34.3 +- 0.12 | 35.34 +- 0.03 | +0.12 +- 0.44 | +3.03 +- 0.38 | | 78b-4t4c-ethip6-ip6scale200k | 15.11 +- 0.11 | 14.64 +- 0.2 | 14.53 +- 0.15 | 14.96 +- 0.13 | -0.74 +- 1.69 | +2.94 +- 1.4 | | 64b-4t4c-af-xdp-eth-l2patch | 4.51 +- 0.02 | 4.52 +- 0.02 | 4.49 +- 0.03 | 4.62 +- 0.03 | -0.71 +- 0.76 | +2.88 +- 0.89 | | 78b-4t4c-ethip6-ip6base | 29.79 +- 0.05 | 28.51 +- 0.12 | 28.74 +- 0.1 | 29.47 +- 0.08 | +0.82 +- 0.56 | +2.53 +- 0.45 | | 64b-4t4c-af-xdp-eth-l2bdbasemaclrn | 2.17 +- 0.02 | 2.12 +- 0.02 | 2.12 +- 0.01 | 2.16 +- 0.02 | +0.15 +- 1.28 | +2.08 +- 1.07 | | 78b-4t4c-af-xdp-ethip6-ip6scale20k | 1.4 +- 0.01 | 1.38 +- 0.01 | 1.38 +- 0.01 | 1.4 +- 0.01 | -0.36 +- 1.09 | +2.06 +- 0.95 | | 1518b-4t4c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm-udir | 1.4 +- 0.01 | 1.4 +- 0.0 | 1.4 +- 0.01 | 1.42 +- 0.01 | -0.29 +- 0.62 | +1.84 +- 0.85 | | 64b-4t4c-ethip4-ip4base-iacldstbase | 20.51 +- 0.24 | 20.76 +- 0.13 | 20.64 +- 0.17 | 20.97 +- 0.1 | -0.61 +- 1.03 | +1.63 +- 0.97 | | 64b-4t4c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm-udir | 2.13 +- 0.0 | 2.21 +- 0.0 | 2.23 +- 0.0 | 2.26 +- 0.0 | +0.56 +- 0.11 | +1.53 +- 0.14 | | 64b-4t4c-af-xdp-eth-l2bdscale10kmaclrn | 1.7 +- 0.0 | 1.68 +- 0.0 | 1.67 +- 0.0 | 1.69 +- 0.0 | -0.3 +- 0.21 | +1.29 +- 0.27 | | 1518b-4t4c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm-udir | 1.78 +- 0.01 | 1.77 +- 0.01 | 1.77 +- 0.01 | 1.79 +- 0.01 | -0.22 +- 0.82 | +1.26 +- 0.7 | | 64b-4t4c-af-xdp-ethip4-ip4base | 1.88 +- 0.01 | 1.85 +- 0.01 | 1.85 +- 0.02 | 1.87 +- 0.0 | -0.08 +- 1.2 | +1.17 +- 1.02 | | imix-4t4c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm-udir | 4.85 +- 0.0 | 4.82 +- 0.0 | 4.82 +- 0.0 | 4.87 +- 0.01 | -0.01 +- 0.11 | +1.03 +- 0.14 | | imix-4t4c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm-udir | 5.23 +- 0.01 | 5.18 +- 0.01 | 5.18 +- 0.01 | 5.21 +- 0.01 | +0.09 +- 0.19 | +0.49 +- 0.2 | | imix-4t4c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm-udir | 4.71 +- 0.0 | 4.61 +- 0.02 | 4.63 +- 0.02 | 4.65 +- 0.03 | +0.41 +- 0.59 | +0.44 +- 0.67 | | 64b-4t4c-af-xdp-eth-l2bdscale100kmaclrn | 1.64 +- 0.0 | 1.62 +- 0.0 | 1.62 +- 0.0 | 1.62 +- 0.0 | -0.11 +- 0.25 | +0.44 +- 0.23 | | 64b-4t4c-eth-l2patch | 35.81 +- 0.04 | 35.83 +- 0.06 | 35.81 +- 0.04 | 35.94 +- 0.03 | -0.06 +- 0.19 | +0.36 +- 0.14 | | 64b-4t4c-af-xdp-ethip4-ip4scale20k | 1.75 +- 0.02 | 1.7 +- 0.01 | 1.71 +- 0.02 | 1.71 +- 0.01 | +0.57 +- 1.13 | +0.24 +- 1.21 | | 1518b-4t4c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm-udir | 1.92 +- 0.01 | 1.91 +- 0.01 | 1.91 +- 0.01 | 1.91 +- 0.01 | +0.16 +- 0.77 | +0.06 +- 0.7 | | 1518b-4t4c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm-udir | 1.91 +- 0.01 | 1.91 +- 0.01 | 1.91 +- 0.01 | 1.91 +- 0.01 | +0.05 +- 0.69 | -0.04 +- 0.61 | | 64b-4t4c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 10.5 +- 0.09 | 10.89 +- 0.07 | 11.5 +- 0.09 | 11.49 +- 0.03 | +5.61 +- 1.05 | -0.13 +- 0.81 | | 64b-4t4c-eth-l2xcbase | 37.09 +- 0.02 | 37.13 +- 0.04 | 37.17 +- 0.03 | 37.01 +- 0.04 | +0.12 +- 0.13 | -0.45 +- 0.13 | | 1518b-4t4c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm-udir | 1.59 +- 0.01 | 1.58 +- 0.01 | 1.58 +- 0.01 | 1.56 +- 0.01 | -0.03 +- 0.63 | -0.93 +- 0.7 | | 1518b-4t4c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | 0.44 +- 0.0 | 0.44 +- 0.0 | 0.44 +- 0.0 | 0.43 +- 0.0 | +0.07 +- 0.7 | -0.99 +- 0.71 | | 1518b-4t4c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | 0.43 +- 0.0 | 0.43 +- 0.0 | 0.43 +- 0.0 | 0.43 +- 0.0 | +0.16 +- 0.71 | -1.01 +- 0.69 | | imix-4t4c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm-udir | 5.88 +- 0.01 | 5.84 +- 0.01 | 5.84 +- 0.01 | 5.77 +- 0.0 | +0.09 +- 0.2 | -1.16 +- 0.15 | | imix-4t4c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | 1.01 +- 0.0 | 1.01 +- 0.0 | 1.01 +- 0.0 | 1.0 +- 0.0 | -0.03 +- 0.08 | -1.39 +- 0.1 | | 64b-4t4c-dot1q-l2bdbasemaclrn | 26.82 +- 0.09 | 26.11 +- 0.07 | 26.17 +- 0.07 | 25.78 +- 0.05 | +0.23 +- 0.37 | -1.47 +- 0.33 | | imix-4t4c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | 0.98 +- 0.0 | 0.98 +- 0.0 | 0.98 +- 0.0 | 0.96 +- 0.0 | -0.02 +- 0.09 | -1.6 +- 0.09 | | imix-4t4c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | 0.94 +- 0.0 | 0.94 +- 0.0 | 0.94 +- 0.0 | 0.92 +- 0.0 | +0.02 +- 0.12 | -2.14 +- 0.13 | | 1518b-4t4c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm-udir | 1.65 +- 0.01 | 1.65 +- 0.0 | 1.65 +- 0.01 | 1.61 +- 0.01 | -0.0 +- 0.51 | -2.28 +- 0.62 | | 64b-4t4c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 21.33 +- 0.11 | 20.27 +- 0.07 | 20.24 +- 0.1 | 19.43 +- 0.09 | -0.12 +- 0.62 | -4.01 +- 0.65 | | 64b-4t4c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm-udir | 7.34 +- 0.03 | 7.65 +- 0.03 | 7.65 +- 0.04 | 7.32 +- 0.04 | -0.09 +- 0.64 | -4.26 +- 0.73 | | 64b-4t4c-ethip4udp-ip4base-iacl50sf-10kflows | 21.98 +- 0.09 | 20.44 +- 0.11 | 20.34 +- 0.08 | 19.28 +- 0.1 | -0.5 +- 0.68 | -5.19 +- 0.64 | | 64b-4t4c-ethip4udp-ip4base-oacl50sf-10kflows | 21.54 +- 0.11 | 20.06 +- 0.1 | 20.08 +- 0.12 | 19.02 +- 0.14 | +0.09 +- 0.76 | -5.28 +- 0.91 | | 64b-4t4c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 20.89 +- 0.1 | 19.62 +- 0.08 | 19.67 +- 0.1 | 18.53 +- 0.14 | +0.25 +- 0.68 | -5.83 +- 0.85 | | 78b-4t4c-af-xdp-ethip6-ip6scale200k | 1.04 +- 0.0 | 1.03 +- 0.01 | 1.02 +- 0.01 | 0.95 +- 0.01 | -0.73 +- 1.5 | -7.63 +- 1.17 | | 64b-4t4c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm-udir | 1.79 +- 0.01 | 1.8 +- 0.01 | 1.8 +- 0.01 | 1.46 +- 0.01 | -0.01 +- 0.57 | -18.71 +- 0.66 | +-----------------------------------------------------------------------+---------------+---------------+---------------+---------------+----------------------+----------------------+ Test Case: Test cases executed for: MRR throughput on 2n-tx2 with xl710. YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "8" for CSIT rls2110, "9" for CSIT rls2202). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2110.0-9 vs 2110.0-8: Compares CSIT environment current vs previous with previous VPP code. 2202.0-9 vs 2110.0-9: Compares VPP code current vs previous in the current CSIT environment.