+--------------------------------------------------------------------+------------------+--------------------+--------------------+------------------------+ | Test Case | 2206.0-10 | 2210.0-11 | 2302.0-11 | 2302.0-11 vs 2210.0-11 | +--------------------------------------------------------------------+------------------+--------------------+--------------------+------------------------+ | 64b-1t1c-ethip4-ip4base | 144.9 +- 9.35 | 173.6 +- 56.65 | 480.67 +- 870.5 | +176.88 +- 509.51 | | 64b-1t1c-ethip4-ip4base-iacldstbase | 197.6 +- 163.37 | 161.7 +- 40.8 | 444.78 +- 646.86 | +175.06 +- 406.01 | | 64b-1t1c-eth-l2patch | 75.3 +- 7.3 | 83.5 +- 5.4 | 209.22 +- 182.9 | +150.57 +- 219.64 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 197.2 +- 183.02 | 219.0 +- 133.79 | 532.11 +- 798.89 | +142.97 +- 393.84 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 179.0 +- 15.71 | 181.3 +- 10.14 | 415.11 +- 200.79 | +128.96 +- 111.49 | | 78b-1t1c-ethip6-ip6scale200k | 226.5 +- 53.52 | 225.2 +- 37.71 | 458.33 +- 303.31 | +103.52 +- 138.93 | | 64b-1t1c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm | 415.3 +- 256.41 | 337.3 +- 159.05 | 664.6 +- 664.53 | +97.04 +- 217.82 | | 78b-1t1c-ethip6-ip6base | 250.5 +- 230.49 | 141.9 +- 16.55 | 273.0 +- 155.78 | +92.39 +- 112.05 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 255.6 +- 245.19 | 210.3 +- 115.64 | 398.33 +- 323.77 | +89.41 +- 185.88 | | 78b-1t1c-ethip6-ip6scale20k | 223.7 +- 165.86 | 298.4 +- 186.83 | 548.0 +- 631.08 | +83.65 +- 240.72 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 123.8 +- 9.78 | 197.3 +- 112.65 | 357.89 +- 179.04 | +81.39 +- 137.7 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 207.9 +- 181.86 | 163.1 +- 44.78 | 281.0 +- 150.23 | +72.29 +- 103.55 | | 64b-1t1c-ethip4-ip4scale200k | 332.8 +- 198.47 | 235.6 +- 27.48 | 390.11 +- 206.41 | +65.58 +- 89.71 | | 64b-1t1c-eth-l2bdscale10kmaclrn | 202.8 +- 166.56 | 179.9 +- 65.9 | 285.78 +- 135.13 | +58.85 +- 95.01 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 262.1 +- 246.53 | 164.6 +- 39.65 | 257.33 +- 49.06 | +56.34 +- 48.03 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 195.4 +- 170.76 | 186.0 +- 136.32 | 276.11 +- 178.56 | +48.45 +- 145.1 | | 78b-1t1c-ethip6-ip6base-iacldstbase | 211.4 +- 180.31 | 295.8 +- 208.52 | 437.89 +- 668.11 | +48.04 +- 248.81 | | 64b-1t1c-ethip4ipsec1000spe-cache-ip4base-policy-outbound-nocrypto | 193.9 +- 174.6 | 186.5 +- 117.26 | 272.11 +- 129.32 | +45.9 +- 114.99 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 1604.2 +- 372.65 | 1721.3 +- 196.54 | 2437.44 +- 1480.12 | +41.6 +- 87.5 | | 64b-1t1c-eth-l2bdbasemaclrn | 242.1 +- 212.72 | 166.4 +- 101.07 | 229.89 +- 180.51 | +38.15 +- 137.14 | | 64b-1t1c-ethip4ipsec100spe-cache-ip4base-policy-outbound-nocrypto | 192.6 +- 175.53 | 196.3 +- 131.13 | 261.4 +- 106.42 | +33.16 +- 104.17 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 271.8 +- 278.12 | 170.6 +- 47.42 | 221.56 +- 36.15 | +29.87 +- 41.86 | | 64b-1t1c-ethip4vxlan-l2xcbase | 275.5 +- 225.18 | 244.4 +- 120.45 | 315.11 +- 157.46 | +28.93 +- 90.49 | | 64b-1t1c-ethip4ipsec1spe-ip4base-policy-outbound-nocrypto | 259.3 +- 247.05 | 232.7 +- 175.15 | 291.0 +- 145.33 | +25.05 +- 112.96 | | 64b-1t1c-ethip4ipsec100spe-ip4base-policy-outbound-nocrypto | 244.0 +- 175.08 | 322.1 +- 180.28 | 401.2 +- 358.77 | +24.56 +- 131.4 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 179.5 +- 143.57 | 190.0 +- 131.76 | 232.33 +- 40.33 | +22.28 +- 87.42 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 188.2 +- 186.42 | 428.6 +- 697.05 | 509.22 +- 886.34 | +18.81 +- 283.02 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm | 1149.4 +- 66.8 | 1144.5 +- 221.85 | 1356.5 +- 309.15 | +18.52 +- 35.46 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 1177.8 +- 254.85 | 1545.78 +- 184.7 | 1824.78 +- 251.45 | +18.05 +- 21.53 | | 64b-1t1c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm | 444.2 +- 212.54 | 405.2 +- 197.9 | 472.8 +- 123.22 | +16.68 +- 64.59 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 1565.2 +- 216.77 | 1627.8 +- 172.97 | 1882.9 +- 357.83 | +15.67 +- 25.19 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 1402.6 +- 346.51 | 1375.2 +- 247.14 | 1588.2 +- 323.23 | +15.49 +- 31.36 | | 64b-1t1c-ethip4ipsec1spe-cache-ip4base-policy-outbound-nocrypto | 148.8 +- 27.18 | 781.8 +- 1659.85 | 893.7 +- 1673.05 | +14.31 +- 323.57 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 1183.1 +- 79.42 | 1260.0 +- 150.14 | 1393.89 +- 116.21 | +10.63 +- 16.09 | | 64b-1t1c-eth-l2bdscale100kmaclrn | 258.5 +- 205.53 | 215.8 +- 133.57 | 221.22 +- 37.83 | +2.51 +- 65.83 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm | 1275.8 +- 246.71 | 1473.9 +- 882.05 | 1454.67 +- 61.92 | -1.3 +- 59.21 | | 64b-1t1c-eth-l2xcbase | 123.9 +- 6.57 | 164.5 +- 125.9 | 160.11 +- 33.19 | -2.67 +- 77.18 | | 64b-1t1c-ethip4-ip4scale20k | 155.2 +- 11.48 | 267.9 +- 218.6 | 252.11 +- 128.87 | -5.89 +- 90.61 | | 64b-1t1c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm | 2375.3 +- 310.5 | 2576.5 +- 374.39 | 2379.9 +- 303.09 | -7.63 +- 17.85 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm | 1647.2 +- 385.91 | 1843.44 +- 428.02 | 1691.33 +- 248.06 | -8.25 +- 25.2 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 1541.6 +- 277.79 | 2026.78 +- 560.49 | 1730.56 +- 375.72 | -14.62 +- 30.02 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 207.7 +- 163.61 | 322.4 +- 214.2 | 259.78 +- 122.87 | -19.42 +- 65.72 | | 64b-1t1c-ethip4ipsec1000spe-ip4base-policy-outbound-nocrypto | 807.6 +- 39.72 | 1687.4 +- 2959.48 | 797.56 +- 709.71 | -52.73 +- 92.96 | +--------------------------------------------------------------------+------------------+--------------------+--------------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 3n-alt with xl710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210 and rls2302). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2302.0-11 vs 2210.0-11: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.