+-------------------------------------------------------------------+--------------+--------------+--------------+------------------------+ | Test Case | 2206.0-10 | 2210.0-11 | 2302.0-11 | 2302.0-11 vs 2210.0-11 | +-------------------------------------------------------------------+--------------+--------------+--------------+------------------------+ | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 0.68 +- 0.21 | 0.06 +- 0.0 | 0.64 +- 0.26 | +982.91 +- 439.48 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm-vppip4 | 0.85 +- 0.25 | 0.06 +- 0.04 | 0.63 +- 0.39 | +883.16 +- 887.77 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 0.68 +- 0.35 | 0.06 +- 0.0 | 0.52 +- 0.14 | +777.09 +- 245.14 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 1.07 +- 0.39 | 0.08 +- 0.03 | 0.65 +- 0.29 | +681.38 +- 460.11 | | 64b-1t1c-eth-l2patch | 5.51 +- 1.22 | 0.56 +- 0.3 | 3.93 +- 2.18 | +598.34 +- 541.44 | | 78b-1t1c-ethip6srhip6-ip6base-srv6enc2sids-nodecaps | 3.15 +- 1.18 | 0.81 +- 0.28 | 3.48 +- 0.01 | +331.04 +- 148.17 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 3.3 +- 1.16 | 0.87 +- 0.34 | 3.65 +- 0.01 | +320.86 +- 163.76 | | 78b-1t1c-ethip6srhip6-ip6base-srv6proxy-dyn | 2.52 +- 0.03 | 0.6 +- 0.3 | 2.47 +- 0.01 | +314.15 +- 210.44 | | 64b-1t1c-ethip4-ip4base | 5.77 +- 0.01 | 1.41 +- 0.47 | 5.8 +- 0.01 | +312.91 +- 138.96 | | 64b-1t1c-ethip4vxlan-l2xcbase | 3.43 +- 1.73 | 1.03 +- 0.01 | 4.18 +- 0.01 | +307.41 +- 4.55 | | 78b-1t1c-ethip6ip6-ip6base-srv6enc1sid | 3.89 +- 0.01 | 0.94 +- 0.31 | 3.8 +- 0.02 | +304.81 +- 131.56 | | 78b-1t1c-ethip6srhip6-ip6base-srv6enc2sids | 3.29 +- 0.01 | 0.82 +- 0.25 | 3.26 +- 0.01 | +298.98 +- 123.56 | | 64b-1t1c-eth-l2xcbase | 6.27 +- 2.25 | 1.55 +- 0.03 | 6.13 +- 2.14 | +295.96 +- 138.16 | | 78b-1t1c-ethip6-ip6base | 4.56 +- 1.84 | 1.2 +- 0.11 | 4.54 +- 1.69 | +278.31 +- 145.07 | | 78b-1t1c-ethip6srhip6-ip6base-srv6proxy-masq | 2.76 +- 0.01 | 0.69 +- 0.11 | 2.48 +- 0.65 | +259.17 +- 110.12 | | 64b-1t1c-eth-l2bdbasemaclrn | 5.02 +- 1.87 | 1.55 +- 0.02 | 5.47 +- 0.02 | +252.08 +- 4.56 | | 78b-1t1c-ethip6srhip6-ip6base-srv6proxy-stat | 2.25 +- 0.96 | 0.72 +- 0.1 | 2.51 +- 0.13 | +249.12 +- 53.67 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 4.36 +- 1.52 | 1.25 +- 0.62 | 4.28 +- 0.03 | +243.75 +- 170.57 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 2.98 +- 1.09 | 1.06 +- 0.69 | 3.43 +- 0.02 | +224.0 +- 212.27 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm | 0.99 +- 0.38 | 0.23 +- 0.05 | 0.74 +- 0.42 | +217.15 +- 195.52 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 3.38 +- 0.05 | 1.16 +- 0.61 | 3.37 +- 0.03 | +190.1 +- 151.67 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 1.02 +- 0.63 | 0.27 +- 0.02 | 0.75 +- 0.36 | +181.01 +- 137.32 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 3.08 +- 0.03 | 0.98 +- 0.7 | 2.74 +- 0.94 | +179.75 +- 222.44 | | imix-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm | 1.34 +- 0.01 | 0.48 +- 0.02 | 1.34 +- 0.0 | +176.21 +- 10.87 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 1.19 +- 0.39 | 0.34 +- 0.22 | 0.93 +- 0.44 | +172.66 +- 219.21 | | imix-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 1.27 +- 0.0 | 0.5 +- 0.01 | 1.28 +- 0.01 | +154.73 +- 3.37 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 0.65 +- 0.02 | 0.38 +- 0.21 | 0.89 +- 0.49 | +132.1 +- 180.13 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 2.96 +- 1.08 | 1.49 +- 0.0 | 3.33 +- 0.01 | +123.64 +- 0.96 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 3.04 +- 0.01 | 1.36 +- 0.41 | 3.0 +- 0.01 | +120.73 +- 67.41 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 3.06 +- 1.21 | 1.49 +- 0.01 | 3.13 +- 1.08 | +110.67 +- 72.65 | | imix-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm | 0.99 +- 0.01 | 0.49 +- 0.02 | 0.96 +- 0.02 | +95.81 +- 9.82 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm | 0.51 +- 0.19 | 0.29 +- 0.01 | 0.57 +- 0.0 | +95.33 +- 4.6 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 3.21 +- 0.03 | 1.45 +- 0.12 | 2.77 +- 1.03 | +91.48 +- 73.15 | | imix-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 0.85 +- 0.29 | 0.49 +- 0.01 | 0.93 +- 0.01 | +90.05 +- 4.16 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 0.53 +- 0.0 | 0.29 +- 0.03 | 0.53 +- 0.0 | +86.37 +- 19.47 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 3.16 +- 0.01 | 1.34 +- 0.46 | 2.41 +- 1.31 | +79.92 +- 115.7 | | 64b-1t1c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm | 1.77 +- 0.64 | 0.99 +- 0.02 | 1.76 +- 0.58 | +77.01 +- 58.81 | | 64b-1t1c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm | 1.66 +- 0.01 | 0.97 +- 0.09 | 1.65 +- 0.01 | +70.7 +- 15.22 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 2.15 +- 0.06 | 1.34 +- 0.46 | 2.11 +- 0.01 | +57.16 +- 53.81 | | imix-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm | 0.6 +- 0.25 | 0.44 +- 0.13 | 0.69 +- 0.0 | +55.52 +- 47.19 | | imix-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 0.67 +- 0.0 | 0.43 +- 0.14 | 0.67 +- 0.0 | +54.12 +- 49.65 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm | 0.47 +- 0.0 | 0.3 +- 0.0 | 0.44 +- 0.0 | +49.09 +- 2.53 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 0.43 +- 0.0 | 0.29 +- 0.01 | 0.38 +- 0.13 | +31.81 +- 44.06 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm | 0.41 +- 0.0 | 0.29 +- 0.01 | 0.38 +- 0.01 | +31.66 +- 4.23 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 0.38 +- 0.0 | 0.28 +- 0.01 | 0.37 +- 0.0 | +30.72 +- 6.14 | | 64b-1t1c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm | 0.3 +- 0.0 | 0.26 +- 0.08 | 0.31 +- 0.0 | +18.36 +- 37.79 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.1 +- 0.0 | 0.09 +- 0.0 | 0.09 +- 0.0 | -0.43 +- 0.87 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.11 +- 0.0 | 0.09 +- 0.0 | 0.09 +- 0.0 | -0.6 +- 0.61 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.11 +- 0.0 | 0.09 +- 0.0 | 0.09 +- 0.0 | -0.77 +- 0.53 | | imix-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.25 +- 0.0 | 0.17 +- 0.0 | 0.17 +- 0.0 | -0.96 +- 0.95 | | imix-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.23 +- 0.0 | 0.16 +- 0.0 | 0.15 +- 0.02 | -3.3 +- 11.53 | | imix-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.2 +- 0.0 | 0.15 +- 0.0 | 0.13 +- 0.04 | -9.6 +- 27.31 | +-------------------------------------------------------------------+--------------+--------------+--------------+------------------------+ Test Case: Test cases executed for: NDR throughput on 3n-tsh with x520. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210 and rls2302). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2302.0-11 vs 2210.0-11: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.