+--------------------------------------------------------------------+----------------+-----------------+-----------------+------------------------+ | Test Case | 2206.0-10 | 2210.0-11 | 2302.0-11 | 2302.0-11 vs 2210.0-11 | +--------------------------------------------------------------------+----------------+-----------------+-----------------+------------------------+ | 64b-1t1c-eth-l2bdbasemaclrn | 39.6 +- 3.89 | 34.1 +- 2.73 | 39.33 +- 3.0 | +15.35 +- 12.75 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 43.2 +- 6.63 | 36.4 +- 8.24 | 40.89 +- 8.84 | +12.33 +- 35.15 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 38.5 +- 3.03 | 36.1 +- 3.21 | 39.67 +- 1.94 | +9.88 +- 11.15 | | 64b-1t1c-ethip4ipsec1spe-ip4base-policy-outbound-nocrypto | 37.9 +- 3.28 | 36.8 +- 4.08 | 39.3 +- 4.14 | +6.79 +- 16.32 | | 78b-1t1c-ethip6-ip6base | 39.8 +- 8.05 | 37.0 +- 4.67 | 39.22 +- 6.55 | +6.01 +- 22.19 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 38.5 +- 4.01 | 35.7 +- 2.54 | 37.56 +- 4.03 | +5.2 +- 13.56 | | 64b-1t1c-ethip4-ip4scale200k | 41.8 +- 4.61 | 36.9 +- 6.14 | 38.67 +- 6.14 | +4.79 +- 24.1 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 39.1 +- 3.51 | 35.9 +- 3.48 | 37.44 +- 2.24 | +4.3 +- 11.88 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 38.2 +- 4.32 | 34.3 +- 2.54 | 35.44 +- 2.19 | +3.34 +- 9.96 | | 64b-1t1c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm | 57.4 +- 7.96 | 49.9 +- 5.2 | 51.5 +- 5.48 | +3.21 +- 15.37 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 38.2 +- 4.42 | 36.1 +- 3.96 | 37.22 +- 2.44 | +3.11 +- 13.17 | | 64b-1t1c-eth-l2patch | 26.9 +- 2.96 | 25.6 +- 1.58 | 26.33 +- 3.16 | +2.86 +- 13.88 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 39.2 +- 3.46 | 36.3 +- 3.5 | 36.89 +- 1.96 | +1.62 +- 11.19 | | 64b-1t1c-ethip4ipsec1spe-cache-ip4base-policy-outbound-nocrypto | 37.0 +- 3.09 | 37.4 +- 6.59 | 37.9 +- 3.93 | +1.34 +- 20.71 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 38.2 +- 2.49 | 35.5 +- 2.01 | 35.89 +- 2.76 | +1.1 +- 9.66 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 42.5 +- 4.25 | 40.4 +- 3.86 | 40.56 +- 2.6 | +0.39 +- 11.56 | | 64b-1t1c-ethip4ipsec1000spe-cache-ip4base-policy-outbound-nocrypto | 38.9 +- 2.69 | 38.1 +- 3.54 | 38.22 +- 4.27 | +0.32 +- 14.57 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 37.6 +- 4.55 | 35.2 +- 2.86 | 35.22 +- 2.44 | +0.06 +- 10.68 | | 64b-1t1c-eth-l2bdscale10kmaclrn | 43.5 +- 4.12 | 39.3 +- 5.91 | 38.89 +- 1.69 | -1.05 +- 15.49 | | 64b-1t1c-ethip4ipsec100spe-ip4base-policy-outbound-nocrypto | 41.7 +- 3.83 | 39.8 +- 3.61 | 39.1 +- 5.0 | -1.76 +- 15.41 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 41.9 +- 5.67 | 38.9 +- 3.07 | 38.0 +- 7.87 | -2.31 +- 21.66 | | 64b-1t1c-eth-l2xcbase | 40.1 +- 4.65 | 34.4 +- 3.66 | 33.56 +- 3.61 | -2.45 +- 14.75 | | 78b-1t1c-ethip6-ip6scale20k | 44.5 +- 4.2 | 40.3 +- 5.19 | 39.11 +- 2.71 | -2.95 +- 14.19 | | 64b-1t1c-ethip4vxlan-l2xcbase | 41.4 +- 3.34 | 41.6 +- 4.43 | 39.78 +- 3.49 | -4.38 +- 13.19 | | 78b-1t1c-ethip6-ip6scale200k | 45.1 +- 6.28 | 42.6 +- 7.71 | 40.44 +- 6.77 | -5.06 +- 23.39 | | 64b-1t1c-ethip4-ip4base | 39.2 +- 2.94 | 39.8 +- 2.53 | 37.78 +- 1.86 | -5.08 +- 7.63 | | 64b-1t1c-eth-l2bdscale100kmaclrn | 43.6 +- 3.37 | 38.7 +- 3.83 | 36.67 +- 3.24 | -5.25 +- 12.57 | | 64b-1t1c-ethip4ipsec1000spe-ip4base-policy-outbound-nocrypto | 81.2 +- 21.18 | 63.7 +- 12.07 | 58.67 +- 10.55 | -7.9 +- 24.06 | | 78b-1t1c-ethip6-ip6base-iacldstbase | 36.4 +- 3.66 | 40.8 +- 11.28 | 37.0 +- 3.61 | -9.31 +- 26.59 | | 64b-1t1c-ethip4-ip4scale20k | 39.1 +- 10.13 | 39.6 +- 10.02 | 35.89 +- 9.18 | -9.37 +- 32.62 | | 64b-1t1c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm | 62.5 +- 9.12 | 55.9 +- 10.17 | 50.6 +- 7.92 | -9.48 +- 21.72 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 167.8 +- 28.26 | 128.5 +- 26.85 | 115.7 +- 23.49 | -9.96 +- 26.23 | | 64b-1t1c-ethip4ipsec100spe-cache-ip4base-policy-outbound-nocrypto | 38.2 +- 2.15 | 40.6 +- 6.47 | 36.4 +- 3.34 | -10.34 +- 16.48 | | 64b-1t1c-ethip4-ip4base-iacldstbase | 42.4 +- 11.55 | 47.6 +- 6.22 | 41.22 +- 10.79 | -13.4 +- 25.34 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 152.8 +- 37.02 | 145.78 +- 35.53 | 114.33 +- 31.7 | -21.57 +- 28.95 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm | 188.2 +- 26.35 | 146.44 +- 42.18 | 114.56 +- 21.21 | -21.78 +- 26.78 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 160.8 +- 22.25 | 140.8 +- 26.69 | 108.0 +- 17.86 | -23.3 +- 19.3 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm | 198.4 +- 33.3 | 158.9 +- 46.61 | 120.3 +- 18.0 | -24.29 +- 24.93 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 220.7 +- 30.42 | 166.2 +- 36.58 | 125.33 +- 30.21 | -24.59 +- 24.61 | | 64b-1t1c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm | 189.3 +- 26.06 | 194.2 +- 40.47 | 144.8 +- 20.74 | -25.44 +- 18.86 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm | 208.4 +- 32.43 | 175.7 +- 44.14 | 130.33 +- 29.53 | -25.82 +- 25.09 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 200.6 +- 29.05 | 151.7 +- 40.61 | 109.3 +- 14.77 | -27.95 +- 21.61 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 196.1 +- 33.33 | 167.67 +- 42.12 | 100.44 +- 27.36 | -40.09 +- 22.2 | +--------------------------------------------------------------------+----------------+-----------------+-----------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 3n-alt with xl710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210 and rls2302). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2302.0-11 vs 2210.0-11: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.