+-------------------------------------------------------------------+-----------------+-----------------+-----------------+------------------------+ | Test Case | 2206.0-10 | 2210.0-11 | 2302.0-11 | 2302.0-11 vs 2210.0-11 | +-------------------------------------------------------------------+-----------------+-----------------+-----------------+------------------------+ | 64b-1t1c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm | 223.11 +- 34.39 | 241.5 +- 49.26 | 292.6 +- 36.77 | +21.16 +- 29.03 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 189.17 +- 29.68 | 188.0 +- 17.95 | 206.78 +- 22.95 | +9.99 +- 16.1 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 152.5 +- 18.83 | 167.0 +- 12.12 | 182.0 +- 24.22 | +8.98 +- 16.52 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 166.0 +- 14.18 | 185.0 +- 32.37 | 198.3 +- 28.2 | +7.19 +- 24.17 | | 64b-1t1c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm | 128.44 +- 13.33 | 148.0 +- 24.12 | 155.4 +- 22.58 | +5.0 +- 22.93 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm | 173.22 +- 30.85 | 181.33 +- 34.06 | 187.6 +- 38.32 | +3.46 +- 28.71 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 54.12 +- 4.26 | 62.78 +- 5.31 | 64.9 +- 10.14 | +3.38 +- 18.36 | | 64b-1t1c-eth-l2xcbase | 55.89 +- 4.46 | 60.2 +- 4.42 | 62.2 +- 4.54 | +3.32 +- 10.69 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm | 202.67 +- 14.62 | 209.8 +- 29.69 | 215.38 +- 36.77 | +2.66 +- 22.76 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 206.38 +- 24.67 | 207.4 +- 25.39 | 212.67 +- 30.65 | +2.54 +- 19.39 | | 78b-1t1c-ethip6ip6-ip6base-srv6enc1sid | 80.43 +- 8.0 | 90.4 +- 14.03 | 92.6 +- 5.4 | +2.43 +- 16.99 | | 64b-1t1c-eth-l2bdbasemaclrn | 61.89 +- 4.08 | 70.2 +- 5.81 | 71.3 +- 4.64 | +1.57 +- 10.69 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 95.9 +- 6.77 | 103.33 +- 25.49 | 104.3 +- 9.33 | +0.94 +- 26.48 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 59.22 +- 5.63 | 64.0 +- 3.23 | 63.9 +- 5.72 | -0.16 +- 10.27 | | 78b-1t1c-ethip6srhip6-ip6base-srv6enc2sids | 86.44 +- 11.53 | 100.8 +- 19.32 | 100.6 +- 12.29 | -0.2 +- 22.69 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 180.22 +- 11.13 | 197.0 +- 8.72 | 194.57 +- 11.41 | -1.23 +- 7.26 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 181.78 +- 21.21 | 184.0 +- 33.18 | 181.22 +- 41.49 | -1.51 +- 28.71 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 206.14 +- 15.51 | 221.7 +- 34.5 | 216.1 +- 25.64 | -2.53 +- 19.07 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 160.38 +- 20.28 | 209.11 +- 29.83 | 203.4 +- 36.8 | -2.73 +- 22.41 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 254.4 +- 48.05 | 242.2 +- 64.91 | 235.56 +- 56.5 | -2.74 +- 34.98 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 57.56 +- 6.73 | 66.2 +- 8.36 | 64.3 +- 6.65 | -2.87 +- 15.86 | | 78b-1t1c-ethip6-ip6base | 56.0 +- 4.57 | 66.2 +- 7.87 | 63.67 +- 7.0 | -3.83 +- 15.57 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 59.0 +- 5.48 | 64.9 +- 27.67 | 62.11 +- 10.02 | -4.3 +- 43.63 | | 64b-1t1c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm | 137.89 +- 17.69 | 147.33 +- 22.05 | 139.4 +- 22.03 | -5.38 +- 20.59 | | 64b-1t1c-ethip4vxlan-l2xcbase | 91.4 +- 10.05 | 100.9 +- 14.14 | 95.0 +- 10.08 | -5.85 +- 16.55 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 56.44 +- 3.24 | 69.6 +- 23.23 | 65.5 +- 4.25 | -5.89 +- 32.0 | | 64b-1t1c-eth-l2patch | 35.25 +- 2.96 | 43.0 +- 5.1 | 40.3 +- 3.53 | -6.28 +- 13.82 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 56.88 +- 9.06 | 70.67 +- 22.78 | 64.8 +- 10.42 | -8.3 +- 33.04 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 49.88 +- 6.69 | 72.2 +- 25.08 | 65.5 +- 11.9 | -9.28 +- 35.56 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 234.67 +- 21.9 | 226.33 +- 29.77 | 205.2 +- 45.69 | -9.34 +- 23.45 | | 64b-1t1c-ethip4-ip4base | 59.14 +- 7.17 | 74.4 +- 14.19 | 67.11 +- 8.8 | -9.8 +- 20.88 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 173.33 +- 23.1 | 209.9 +- 45.26 | 186.9 +- 28.12 | -10.96 +- 23.41 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm | 214.38 +- 29.04 | 230.33 +- 41.55 | 203.25 +- 32.9 | -11.76 +- 21.39 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 66.0 +- 5.94 | 95.1 +- 11.02 | 83.89 +- 14.24 | -11.79 +- 18.13 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 60.0 +- 8.2 | 83.1 +- 26.4 | 70.22 +- 3.99 | -15.5 +- 27.28 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 131.78 +- 15.93 | 164.0 +- 55.15 | 136.86 +- 13.2 | -16.55 +- 29.2 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm-vppip4 | 164.22 +- 17.06 | 207.0 +- 12.73 | 168.57 +- 32.7 | -18.56 +- 16.57 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 56.22 +- 11.17 | 81.3 +- 33.17 | 63.78 +- 11.71 | -21.55 +- 35.1 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm | 224.38 +- 27.91 | 275.1 +- 50.8 | 199.1 +- 33.39 | -27.63 +- 18.05 | +-------------------------------------------------------------------+-----------------+-----------------+-----------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210 and rls2302). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2302.0-11 vs 2210.0-11: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.