+--------------------------------------------------------------------+-----------------+------------------+-----------------+------------------------+ | Test Case | 2206.0-10 | 2210.0-11 | 2302.0-11 | 2302.0-11 vs 2210.0-11 | +--------------------------------------------------------------------+-----------------+------------------+-----------------+------------------------+ | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm | 492.0 +- 20.4 | 559.22 +- 35.22 | 699.33 +- 48.73 | +25.05 +- 11.75 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm | 583.6 +- 37.95 | 462.7 +- 34.14 | 566.7 +- 63.96 | +22.48 +- 16.52 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 535.1 +- 114.57 | 644.22 +- 90.97 | 778.44 +- 65.88 | +20.83 +- 19.89 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm | 588.9 +- 60.03 | 579.7 +- 42.68 | 678.0 +- 52.96 | +16.96 +- 12.55 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 66.5 +- 3.24 | 59.9 +- 3.93 | 69.22 +- 4.24 | +15.56 +- 10.37 | | 64b-1t1c-ethip4ipsec1000spe-cache-ip4base-policy-outbound-nocrypto | 62.8 +- 3.55 | 59.1 +- 3.14 | 67.44 +- 6.46 | +14.12 +- 12.51 | | 64b-1t1c-ethip4ipsec100spe-cache-ip4base-policy-outbound-nocrypto | 64.1 +- 3.98 | 58.5 +- 5.3 | 66.6 +- 6.24 | +13.85 +- 14.83 | | 64b-1t1c-ethip4ipsec100spe-ip4base-policy-outbound-nocrypto | 82.4 +- 6.19 | 76.1 +- 12.18 | 86.3 +- 9.99 | +13.4 +- 22.4 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 59.4 +- 3.41 | 57.3 +- 4.67 | 64.33 +- 7.84 | +12.27 +- 16.46 | | 64b-1t1c-ethip4ipsec1spe-ip4base-policy-outbound-nocrypto | 64.2 +- 4.83 | 61.2 +- 4.34 | 68.6 +- 5.93 | +12.09 +- 12.53 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 657.8 +- 96.32 | 737.8 +- 49.94 | 823.56 +- 39.87 | +11.62 +- 9.29 | | 78b-1t1c-ethip6-ip6scale200k | 88.0 +- 6.85 | 85.0 +- 11.76 | 94.22 +- 11.38 | +10.85 +- 20.35 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 60.8 +- 6.63 | 56.8 +- 4.37 | 62.89 +- 5.33 | +10.72 +- 12.66 | | 64b-1t1c-ethip4ipsec1spe-cache-ip4base-policy-outbound-nocrypto | 65.4 +- 3.53 | 64.5 +- 5.52 | 71.2 +- 7.81 | +10.39 +- 15.37 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 59.5 +- 3.24 | 54.7 +- 5.1 | 59.89 +- 5.78 | +9.49 +- 14.69 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 587.4 +- 83.91 | 620.22 +- 73.12 | 676.44 +- 72.43 | +9.06 +- 17.37 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 59.6 +- 3.89 | 55.6 +- 3.5 | 60.22 +- 5.07 | +8.31 +- 11.39 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 62.5 +- 8.34 | 63.7 +- 6.9 | 68.44 +- 10.19 | +7.45 +- 19.78 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 65.4 +- 4.4 | 58.8 +- 4.05 | 62.56 +- 5.68 | +6.39 +- 12.13 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 647.6 +- 57.77 | 677.3 +- 69.8 | 714.9 +- 79.56 | +5.55 +- 16.01 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 67.1 +- 6.17 | 61.8 +- 3.29 | 65.0 +- 4.21 | +5.18 +- 8.83 | | 64b-1t1c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm | 123.1 +- 12.35 | 113.9 +- 10.63 | 119.2 +- 11.01 | +4.65 +- 13.74 | | 64b-1t1c-ethip4-ip4scale20k | 77.9 +- 3.6 | 65.7 +- 2.79 | 68.11 +- 4.48 | +3.67 +- 8.12 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 628.0 +- 40.55 | 605.0 +- 67.31 | 627.11 +- 50.51 | +3.65 +- 14.24 | | 78b-1t1c-ethip6-ip6base | 68.8 +- 4.42 | 64.4 +- 4.72 | 65.89 +- 3.95 | +2.31 +- 9.69 | | 64b-1t1c-eth-l2bdscale10kmaclrn | 71.8 +- 5.45 | 66.5 +- 5.13 | 68.0 +- 5.77 | +2.26 +- 11.72 | | 64b-1t1c-ethip4-ip4scale200k | 77.9 +- 4.12 | 69.0 +- 2.83 | 69.89 +- 3.92 | +1.29 +- 7.04 | | 64b-1t1c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm | 141.4 +- 20.63 | 134.7 +- 8.77 | 136.1 +- 19.76 | +1.04 +- 16.07 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 64.2 +- 2.97 | 63.5 +- 3.44 | 63.0 +- 3.74 | -0.79 +- 7.98 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 659.3 +- 84.18 | 778.3 +- 64.04 | 765.5 +- 83.58 | -1.64 +- 13.45 | | 78b-1t1c-ethip6-ip6scale20k | 81.7 +- 3.13 | 77.1 +- 4.53 | 75.22 +- 6.57 | -2.44 +- 10.27 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 75.1 +- 6.49 | 67.3 +- 8.11 | 64.89 +- 2.93 | -3.58 +- 12.41 | | 64b-1t1c-eth-l2bdbasemaclrn | 72.7 +- 7.21 | 61.3 +- 1.83 | 58.67 +- 2.29 | -4.3 +- 4.7 | | 64b-1t1c-ethip4-ip4base | 74.6 +- 3.98 | 66.1 +- 2.13 | 62.89 +- 3.22 | -4.86 +- 5.76 | | 78b-1t1c-ethip6-ip6base-iacldstbase | 74.1 +- 3.28 | 72.2 +- 4.73 | 68.56 +- 5.96 | -5.05 +- 10.34 | | 64b-1t1c-ethip4-ip4base-iacldstbase | 75.1 +- 5.53 | 69.8 +- 3.68 | 66.11 +- 3.86 | -5.28 +- 7.44 | | 64b-1t1c-ethip4vxlan-l2xcbase | 80.2 +- 7.9 | 77.0 +- 3.86 | 72.22 +- 2.77 | -6.2 +- 5.92 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 86.3 +- 6.07 | 83.6 +- 2.55 | 78.33 +- 6.0 | -6.3 +- 7.72 | | 64b-1t1c-eth-l2bdscale100kmaclrn | 75.9 +- 4.58 | 74.8 +- 4.08 | 68.33 +- 6.44 | -8.65 +- 9.95 | | 64b-1t1c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm | 903.5 +- 171.81 | 973.4 +- 166.77 | 829.2 +- 84.03 | -14.81 +- 16.96 | | 64b-1t1c-eth-l2xcbase | 69.1 +- 4.91 | 59.9 +- 1.91 | 50.67 +- 2.4 | -15.41 +- 4.83 | | 64b-1t1c-eth-l2patch | 41.2 +- 1.48 | 43.8 +- 2.04 | 36.78 +- 1.09 | -16.03 +- 4.65 | | 64b-1t1c-ethip4ipsec1000spe-ip4base-policy-outbound-nocrypto | 331.2 +- 33.73 | 307.9 +- 38.84 | 216.22 +- 43.73 | -29.78 +- 16.74 | +--------------------------------------------------------------------+-----------------+------------------+-----------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 3n-alt with xl710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210 and rls2302). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2302.0-11 vs 2210.0-11: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.