+--------------------------------------------------------------------+------------------+-------------------+-------------------+------------------------+ | Test Case | 2206.0-10 | 2210.0-11 | 2302.0-11 | 2302.0-11 vs 2210.0-11 | +--------------------------------------------------------------------+------------------+-------------------+-------------------+------------------------+ | 64b-1t1c-ethip4ipsec100spe-ip4base-policy-outbound-nocrypto | 287.7 +- 224.42 | 296.6 +- 33.65 | 2491.9 +- 4257.33 | +740.16 +- 1438.54 | | 64b-1t1c-af-xdp-eth-l2bdscale10kmaclrn | 127.2 +- 24.72 | 191.2 +- 148.01 | 1339.5 +- 3669.49 | +600.58 +- 1994.34 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 157.0 +- 38.09 | 202.5 +- 30.37 | 1355.9 +- 3711.26 | +569.58 +- 1835.47 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 137.4 +- 32.98 | 208.2 +- 18.1 | 1128.8 +- 2902.95 | +442.17 +- 1395.1 | | 64b-1t1c-ethip4ipsec1000spe-cache-ip4base-policy-outbound-nocrypto | 198.9 +- 188.64 | 184.1 +- 43.38 | 912.6 +- 1805.66 | +395.71 +- 987.73 | | 78b-1t1c-af-xdp-ethip6-ip6scale20k | 125.0 +- 32.8 | 251.0 +- 186.5 | 1049.0 +- 2696.63 | +317.93 +- 1118.33 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 339.8 +- 302.95 | 293.9 +- 326.87 | 938.0 +- 1686.43 | +219.16 +- 674.72 | | 64b-1t1c-af-xdp-ethip4-ip4scale20k | 124.3 +- 34.29 | 239.7 +- 147.54 | 593.5 +- 855.14 | +147.6 +- 387.94 | | 64b-1t1c-ethip4ipsec1spe-ip4base-policy-outbound-nocrypto | 156.9 +- 37.39 | 260.0 +- 324.08 | 619.1 +- 1415.24 | +138.12 +- 619.98 | | 64b-1t1c-af-xdp-eth-l2patch | 132.9 +- 3.0 | 134.0 +- 48.51 | 286.5 +- 211.43 | +113.81 +- 175.75 | | 78b-1t1c-ethip6-ip6scale20k | 121.8 +- 17.96 | 156.6 +- 36.4 | 287.6 +- 302.22 | +83.65 +- 197.65 | | 64b-1t1c-ethip4-ip4scale200k | 189.8 +- 232.1 | 982.3 +- 2591.59 | 1664.9 +- 4011.26 | +69.49 +- 605.56 | | 78b-1t1c-ethip6-ip6base-iacldstbase | 184.8 +- 179.27 | 833.3 +- 2150.28 | 1273.4 +- 3574.36 | +52.81 +- 582.65 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 213.2 +- 203.75 | 191.2 +- 23.8 | 282.7 +- 304.98 | +47.86 +- 160.56 | | 64b-1t1c-af-xdp-ethip4-ip4scale200k | 144.2 +- 84.15 | 127.4 +- 67.78 | 186.8 +- 70.87 | +46.62 +- 95.81 | | 78b-1t1c-ethip6-ip6scale200k | 147.4 +- 30.07 | 279.6 +- 316.96 | 377.6 +- 462.61 | +35.05 +- 225.42 | | 64b-1t1c-af-xdp-eth-l2bdbasemaclrn | 150.3 +- 52.69 | 182.0 +- 152.44 | 235.4 +- 207.55 | +29.34 +- 157.29 | | 64b-1t1c-eth-l2xcbase-eth-2memif-1dcr | 199.5 +- 48.9 | 224.7 +- 53.39 | 275.1 +- 146.83 | +22.43 +- 71.53 | | 64b-1t1c-ethip4-ip4base-eth-2memif-1dcr | 280.9 +- 93.22 | 501.8 +- 157.64 | 591.3 +- 325.21 | +17.84 +- 74.63 | | 78b-1t1c-af-xdp-ethip6-ip6base | 129.8 +- 16.96 | 177.9 +- 156.32 | 202.4 +- 178.65 | +13.77 +- 141.7 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 286.3 +- 268.38 | 176.1 +- 23.6 | 194.3 +- 35.91 | +10.34 +- 25.19 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 223.3 +- 226.36 | 1386.5 +- 3742.93 | 1470.7 +- 3790.03 | +6.07 +- 395.88 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 162.0 +- 19.07 | 184.8 +- 32.2 | 184.9 +- 18.66 | +0.05 +- 20.14 | | 64b-1t1c-af-xdp-ethip4-ip4base | 146.5 +- 36.03 | 144.6 +- 43.46 | 144.6 +- 75.44 | +0.0 +- 60.21 | | 64b-1t1c-eth-l2bdscale100kmaclrn | 120.0 +- 21.78 | 149.9 +- 18.64 | 148.2 +- 29.8 | -1.13 +- 23.37 | | 64b-1t1c-ethip4-ip4base | 101.6 +- 6.64 | 126.0 +- 11.9 | 124.2 +- 16.78 | -1.43 +- 16.25 | | 64b-1t1c-ethip4ipsec100spe-cache-ip4base-policy-outbound-nocrypto | 199.9 +- 194.51 | 193.6 +- 56.73 | 184.9 +- 31.95 | -4.49 +- 32.49 | | 64b-1t1c-ethip4-ip4scale20k | 99.0 +- 16.47 | 140.9 +- 26.15 | 131.5 +- 20.75 | -6.67 +- 22.74 | | 78b-1t1c-ethip6-ip6base | 143.8 +- 174.15 | 129.3 +- 24.06 | 119.9 +- 10.57 | -7.27 +- 19.09 | | 78b-1t1c-af-xdp-ethip6-ip6scale200k | 104.8 +- 44.08 | 146.9 +- 46.5 | 136.2 +- 4.05 | -7.28 +- 29.48 | | 64b-1t1c-eth-l2bdbasemaclrn | 99.5 +- 9.23 | 130.0 +- 17.22 | 119.1 +- 12.82 | -8.38 +- 15.64 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 240.7 +- 225.26 | 359.6 +- 346.58 | 302.4 +- 181.88 | -15.91 +- 95.54 | | 64b-1t1c-af-xdp-eth-l2bdscale100kmaclrn | 113.6 +- 45.49 | 207.6 +- 136.48 | 147.6 +- 13.88 | -28.9 +- 47.22 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 271.9 +- 258.37 | 298.7 +- 330.3 | 202.8 +- 25.47 | -32.11 +- 75.56 | | 64b-1t1c-af-xdp-eth-l2xcbase | 132.7 +- 2.16 | 191.3 +- 167.9 | 127.3 +- 92.65 | -33.46 +- 75.88 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 160.8 +- 27.88 | 310.7 +- 276.83 | 206.3 +- 22.76 | -33.6 +- 59.61 | | 64b-1t1c-ethip4ipsec1spe-cache-ip4base-policy-outbound-nocrypto | 129.9 +- 24.82 | 284.6 +- 323.45 | 177.1 +- 29.75 | -37.77 +- 71.49 | | 64b-1t1c-ethip4ipsec1000spe-ip4base-policy-outbound-nocrypto | 1446.9 +- 488.56 | 2219.1 +- 3070.81 | 1081.7 +- 558.35 | -51.26 +- 71.99 | | 64b-1t1c-eth-l2patch | 64.8 +- 7.73 | 167.0 +- 300.16 | 81.4 +- 6.93 | -51.26 +- 87.71 | | 64b-1t1c-eth-l2xcbase | 93.8 +- 8.53 | 294.4 +- 387.85 | 99.5 +- 18.7 | -66.2 +- 44.98 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 182.3 +- 38.86 | 1242.7 +- 3149.51 | 375.2 +- 358.04 | -69.81 +- 81.76 | | 64b-1t1c-ethip4-ip4base-iacldstbase | 201.4 +- 172.05 | 772.9 +- 1557.31 | 197.4 +- 40.5 | -74.46 +- 51.73 | | 64b-1t1c-eth-l2bdscale10kmaclrn | 114.1 +- 8.17 | 640.7 +- 1257.92 | 145.7 +- 36.0 | -77.26 +- 45.0 | +--------------------------------------------------------------------+------------------+-------------------+-------------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210 and rls2302). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2302.0-11 vs 2210.0-11: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.