+------------------------------------------------------------------------+----------------+----------------+---------------+---------------+----------------------+----------------------+ | Test Case | 2106.0-8 | 2110.0-8 | 2110.0-9 | 2202.0-9 | 2110.0-9 vs 2110.0-8 | 2202.0-9 vs 2110.0-9 | +------------------------------------------------------------------------+----------------+----------------+---------------+---------------+----------------------+----------------------+ | 78b-2t2c-af-xdp-ethip6-ip6scale20k | 0.12 +- 0.08 | 0.23 +- 0.1 | 0.12 +- 0.04 | 0.17 +- 0.12 | -47.19 +- 29.22 | +42.14 +- 107.81 | | 64b-2t2c-af-xdp-ethip4-ip4base | 0.14 +- 0.1 | 0.09 +- 0.04 | 0.09 +- 0.03 | 0.12 +- 0.08 | -1.76 +- 58.22 | +35.71 +- 103.51 | | 64b-2t2c-af-xdp-ethip4-ip4scale20k | 0.17 +- 0.13 | 0.16 +- 0.12 | 0.16 +- 0.1 | 0.17 +- 0.12 | +2.63 +- 103.5 | +6.57 +- 98.51 | | 64b-2t2c-af-xdp-eth-l2bdscale10kmaclrn | 0.21 +- 0.13 | 0.23 +- 0.12 | 0.12 +- 0.08 | 0.13 +- 0.09 | -48.72 +- 42.59 | +6.23 +- 99.94 | | imix-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm-udir | 2.28 +- 0.16 | 2.32 +- 0.11 | 2.27 +- 0.17 | 2.4 +- 0.07 | -2.01 +- 8.78 | +5.69 +- 8.57 | | 78b-2t2c-af-xdp-ethip6-ip6base | 0.15 +- 0.13 | 0.23 +- 0.14 | 0.14 +- 0.13 | 0.15 +- 0.1 | -36.84 +- 67.98 | +4.05 +- 114.53 | | imix-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm-udir | 2.13 +- 0.02 | 2.12 +- 0.02 | 2.14 +- 0.02 | 2.19 +- 0.06 | +1.09 +- 1.48 | +2.19 +- 3.08 | | imix-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm-udir | 2.63 +- 0.23 | 2.79 +- 0.15 | 2.77 +- 0.15 | 2.82 +- 0.05 | -0.48 +- 7.68 | +1.59 +- 5.85 | | imix-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm-udir | 2.02 +- 0.05 | 1.98 +- 0.05 | 2.04 +- 0.03 | 2.06 +- 0.15 | +2.77 +- 3.16 | +1.08 +- 7.51 | | 64b-2t2c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 5.63 +- 0.73 | 5.9 +- 0.81 | 5.39 +- 0.85 | 5.44 +- 0.18 | -8.64 +- 19.08 | +0.99 +- 16.28 | | imix-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm-udir | 2.49 +- 0.14 | 2.47 +- 0.1 | 2.54 +- 0.04 | 2.55 +- 0.03 | +2.81 +- 4.45 | +0.26 +- 2.12 | | 1518b-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm-udir | 0.78 +- 0.0 | 0.78 +- 0.0 | 0.78 +- 0.0 | 0.78 +- 0.0 | -0.01 +- 0.34 | -0.32 +- 0.27 | | 1518b-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm-udir | 1.01 +- 0.01 | 1.01 +- 0.01 | 1.01 +- 0.0 | 1.01 +- 0.0 | +0.05 +- 0.75 | -0.33 +- 0.52 | | 1518b-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | 0.21 +- 0.0 | 0.21 +- 0.0 | 0.21 +- 0.0 | 0.21 +- 0.0 | -0.09 +- 0.4 | -0.61 +- 0.59 | | 1518b-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | 0.22 +- 0.0 | 0.22 +- 0.0 | 0.22 +- 0.0 | 0.22 +- 0.0 | -0.26 +- 0.69 | -0.71 +- 0.67 | | imix-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm-udir | 2.36 +- 0.04 | 2.34 +- 0.02 | 2.36 +- 0.03 | 2.34 +- 0.09 | +0.71 +- 1.55 | -0.75 +- 4.18 | | 1518b-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | 0.21 +- 0.0 | 0.21 +- 0.0 | 0.21 +- 0.0 | 0.21 +- 0.0 | +0.25 +- 0.68 | -1.05 +- 0.81 | | 1518b-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm-udir | 0.79 +- 0.0 | 0.79 +- 0.0 | 0.79 +- 0.0 | 0.78 +- 0.0 | -0.03 +- 0.24 | -1.09 +- 0.27 | | imix-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | 0.5 +- 0.0 | 0.5 +- 0.0 | 0.5 +- 0.0 | 0.5 +- 0.0 | -0.06 +- 0.27 | -1.31 +- 0.28 | | imix-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | 0.49 +- 0.0 | 0.48 +- 0.0 | 0.48 +- 0.0 | 0.48 +- 0.0 | -0.07 +- 0.21 | -1.4 +- 0.17 | | imix-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | 0.48 +- 0.0 | 0.48 +- 0.0 | 0.48 +- 0.0 | 0.48 +- 0.0 | +0.08 +- 0.19 | -1.5 +- 0.22 | | 1518b-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm-udir | 1.04 +- 0.0 | 1.04 +- 0.0 | 1.04 +- 0.0 | 1.02 +- 0.0 | -0.04 +- 0.21 | -1.72 +- 0.23 | | 64b-2t2c-ethip4udp-ip4base-iacl50sl-10kflows | 7.37 +- 2.15 | 6.93 +- 2.21 | 8.22 +- 1.41 | 8.06 +- 0.09 | +18.54 +- 42.91 | -1.9 +- 16.9 | | 1518b-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm-udir | 0.82 +- 0.0 | 0.82 +- 0.0 | 0.82 +- 0.0 | 0.8 +- 0.0 | -0.01 +- 0.15 | -2.4 +- 0.21 | | 1518b-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm-udir | 1.09 +- 0.0 | 1.09 +- 0.0 | 1.09 +- 0.0 | 1.06 +- 0.0 | -0.0 +- 0.19 | -2.46 +- 0.17 | | 64b-2t2c-ethip4-ip4base-iacldstbase | 8.88 +- 3.21 | 7.41 +- 2.58 | 10.3 +- 2.91 | 9.73 +- 0.3 | +39.08 +- 62.37 | -5.57 +- 26.84 | | 64b-2t2c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm-udir | 1.9 +- 0.33 | 2.03 +- 0.36 | 2.16 +- 0.08 | 2.0 +- 0.08 | +6.62 +- 19.56 | -7.54 +- 5.06 | | 64b-2t2c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm-udir | 3.28 +- 0.49 | 3.47 +- 0.53 | 3.62 +- 0.33 | 3.3 +- 0.16 | +4.56 +- 18.63 | -9.02 +- 9.41 | | 64b-2t2c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 7.35 +- 2.01 | 7.57 +- 1.52 | 8.76 +- 0.38 | 7.96 +- 0.22 | +15.74 +- 23.77 | -9.12 +- 4.69 | | 64b-2t2c-eth-l2bdscale10kmaclrn | 10.64 +- 5.93 | 11.82 +- 5.85 | 14.75 +- 3.54 | 13.29 +- 0.28 | +24.77 +- 68.57 | -9.9 +- 21.68 | | 78b-2t2c-ethip6-ip6base-iacldstbase | 8.56 +- 2.91 | 8.78 +- 3.3 | 10.89 +- 2.63 | 9.78 +- 0.29 | +24.02 +- 55.38 | -10.17 +- 21.87 | | 64b-2t2c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 7.71 +- 1.16 | 7.13 +- 1.3 | 8.45 +- 0.3 | 7.5 +- 0.26 | +18.53 +- 22.05 | -11.26 +- 4.45 | | 64b-2t2c-ethip4udp-ip4base-oacl50sl-10kflows | 8.52 +- 0.74 | 7.67 +- 1.79 | 8.9 +- 0.49 | 7.89 +- 0.2 | +16.03 +- 27.85 | -11.36 +- 5.36 | | 64b-2t2c-dot1q-l2bdbasemaclrn | 11.59 +- 4.86 | 9.66 +- 4.75 | 12.87 +- 3.57 | 11.37 +- 0.37 | +33.28 +- 75.25 | -11.61 +- 24.68 | | 64b-2t2c-ethip4udp-ip4base-oacl50sf-10kflows | 9.68 +- 3.78 | 9.37 +- 3.1 | 10.32 +- 2.83 | 9.08 +- 0.28 | +10.11 +- 47.37 | -12.01 +- 24.32 | | 64b-2t2c-eth-l2bdscale100kmaclrn | 12.65 +- 4.57 | 9.32 +- 4.77 | 14.12 +- 3.25 | 12.42 +- 0.39 | +51.58 +- 85.06 | -12.08 +- 20.45 | | 64b-2t2c-eth-l2bdbasemaclrn | 19.83 +- 4.44 | 17.48 +- 6.01 | 18.24 +- 5.77 | 15.98 +- 0.48 | +4.36 +- 48.75 | -12.39 +- 27.82 | | 64b-2t2c-af-xdp-eth-l2bdbasemaclrn | 0.1 +- 0.04 | 0.13 +- 0.11 | 0.15 +- 0.11 | 0.12 +- 0.11 | +9.1 +- 122.05 | -14.37 +- 97.47 | | 64b-2t2c-af-xdp-eth-l2xcbase | 0.13 +- 0.07 | 0.14 +- 0.1 | 0.14 +- 0.05 | 0.12 +- 0.05 | -2.64 +- 74.98 | -14.47 +- 45.27 | | 64b-2t2c-ethip4-ip4base-eth-2memif-1dcr | 7.16 +- 1.34 | 7.49 +- 0.6 | 7.72 +- 0.14 | 6.56 +- 0.55 | +3.09 +- 8.52 | -15.07 +- 7.23 | | 64b-2t2c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 7.99 +- 1.82 | 8.31 +- 1.36 | 8.29 +- 1.3 | 6.96 +- 0.55 | -0.28 +- 22.59 | -15.97 +- 14.73 | | 78b-2t2c-ethip6-ip6base | 13.82 +- 5.65 | 14.2 +- 3.97 | 16.31 +- 1.73 | 13.63 +- 0.32 | +14.86 +- 34.34 | -16.42 +- 9.07 | | 78b-2t2c-ethip6-ip6scale200k | 11.13 +- 0.3 | 10.9 +- 0.12 | 10.82 +- 0.21 | 9.0 +- 0.26 | -0.78 +- 2.23 | -16.82 +- 2.92 | | 64b-2t2c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 8.56 +- 3.64 | 8.19 +- 2.32 | 10.63 +- 1.71 | 8.77 +- 0.25 | +29.71 +- 42.28 | -17.48 +- 13.45 | | 64b-2t2c-af-xdp-eth-l2bdscale100kmaclrn | 0.16 +- 0.11 | 0.21 +- 0.15 | 0.18 +- 0.1 | 0.14 +- 0.12 | -14.82 +- 76.14 | -18.16 +- 82.72 | | 78b-2t2c-ethip6-ip6scale20k | 13.01 +- 1.86 | 8.3 +- 3.51 | 13.49 +- 0.13 | 10.93 +- 0.35 | +62.38 +- 68.65 | -18.93 +- 2.71 | | 64b-2t2c-ethip4-ip4scale20k | 15.6 +- 4.71 | 13.73 +- 4.77 | 16.36 +- 3.31 | 13.26 +- 0.44 | +19.18 +- 47.89 | -18.93 +- 16.6 | | 64b-2t2c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm-udir | 0.89 +- 0.0 | 0.89 +- 0.0 | 0.89 +- 0.0 | 0.72 +- 0.01 | -0.14 +- 0.52 | -19.24 +- 1.02 | | 64b-2t2c-ethip4udp-ip4base-iacl50sf-10kflows | 10.83 +- 2.75 | 8.92 +- 3.16 | 11.39 +- 2.32 | 9.16 +- 0.28 | +27.65 +- 52.15 | -19.6 +- 16.56 | | 64b-2t2c-ethip4-ip4scale200k | 17.39 +- 0.45 | 15.74 +- 1.66 | 16.36 +- 0.16 | 13.13 +- 0.3 | +3.98 +- 11.01 | -19.75 +- 1.99 | | 64b-2t2c-eth-l2patch | 22.25 +- 15.65 | 16.62 +- 12.81 | 34.48 +- 3.59 | 27.21 +- 1.22 | +107.47 +- 161.32 | -21.07 +- 8.95 | | 64b-2t2c-eth-l2xcbase-eth-2memif-1dcr | 9.66 +- 2.39 | 9.4 +- 2.08 | 10.47 +- 0.29 | 8.2 +- 1.23 | +11.34 +- 24.79 | -21.65 +- 11.94 | | 64b-2t2c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 8.63 +- 3.96 | 9.8 +- 2.35 | 11.61 +- 0.25 | 9.07 +- 0.31 | +18.41 +- 28.47 | -21.86 +- 3.14 | | 78b-2t2c-af-xdp-ethip6-ip6scale200k | 0.16 +- 0.1 | 0.12 +- 0.08 | 0.14 +- 0.09 | 0.11 +- 0.04 | +10.98 +- 102.64 | -22.02 +- 59.93 | | 64b-2t2c-ethip4-ip4base | 13.37 +- 7.4 | 13.66 +- 5.6 | 19.03 +- 0.27 | 14.68 +- 0.55 | +39.33 +- 57.1 | -22.9 +- 3.11 | | 64b-2t2c-eth-l2xcbase | 17.68 +- 10.29 | 21.18 +- 5.95 | 26.14 +- 1.89 | 20.04 +- 0.49 | +23.39 +- 35.8 | -23.31 +- 5.85 | | 64b-2t2c-af-xdp-eth-l2patch | 0.1 +- 0.04 | 0.14 +- 0.09 | 0.14 +- 0.09 | 0.11 +- 0.04 | +1.37 +- 88.89 | -27.11 +- 54.75 | | 64b-2t2c-af-xdp-ethip4-ip4scale200k | 0.18 +- 0.13 | 0.14 +- 0.1 | 0.14 +- 0.07 | 0.1 +- 0.05 | +6.37 +- 96.38 | -29.03 +- 48.93 | +------------------------------------------------------------------------+----------------+----------------+---------------+---------------+----------------------+----------------------+ Test Case: Test cases executed for: NDR throughput on 2n-tx2 with xl710. YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "8" for CSIT rls2110, "9" for CSIT rls2202). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2110.0-9 vs 2110.0-8: Compares CSIT environment current vs previous with previous VPP code. 2202.0-9 vs 2110.0-9: Compares VPP code current vs previous in the current CSIT environment.