+--------------------------------------------------------------+-----------------+-----------------+-----------------+------------------------+ | Test Case | 2206.0-10 | 2210.0-11 | 2302.0-11 | 2302.0-11 vs 2210.0-11 | +--------------------------------------------------------------+-----------------+-----------------+-----------------+------------------------+ | 78b-2t1c-af-xdp-ethip6-ip6base | 476.3 +- 633.21 | 295.9 +- 278.08 | 387.5 +- 314.03 | +30.96 +- 162.51 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 204.0 +- 121.2 | 148.7 +- 13.12 | 187.1 +- 119.74 | +25.82 +- 81.29 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k | 296.3 +- 386.51 | 340.0 +- 346.07 | 408.2 +- 358.67 | +20.06 +- 161.44 | | 64b-2t1c-eth-l2bdbasemaclrn | 85.0 +- 3.4 | 74.9 +- 7.74 | 86.8 +- 6.48 | +15.89 +- 14.77 | | 78b-2t1c-avf-ethip6-ip6scale20k | 85.8 +- 9.07 | 77.7 +- 7.73 | 88.5 +- 30.55 | +13.9 +- 40.92 | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 106.9 +- 11.13 | 101.5 +- 23.89 | 115.1 +- 27.55 | +13.4 +- 38.07 | | 64b-2t1c-af-xdp-ethip4-ip4base | 301.5 +- 269.51 | 306.5 +- 279.27 | 346.8 +- 259.12 | +13.15 +- 133.33 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 71.0 +- 5.1 | 75.5 +- 13.42 | 84.9 +- 7.75 | +12.45 +- 22.47 | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 99.8 +- 8.46 | 84.6 +- 6.6 | 92.9 +- 17.96 | +9.81 +- 22.89 | | 64b-2t1c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir | 225.1 +- 35.18 | 198.0 +- 16.25 | 215.2 +- 17.35 | +8.69 +- 12.51 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 212.5 +- 14.22 | 197.2 +- 9.19 | 214.1 +- 9.1 | +8.57 +- 6.85 | | 64b-2t1c-avf-eth-l2xcbase | 66.5 +- 6.54 | 58.5 +- 5.58 | 63.3 +- 8.19 | +8.21 +- 17.4 | | 78b-2t1c-ethip6-ip6base | 86.8 +- 3.65 | 73.4 +- 6.04 | 79.2 +- 5.67 | +7.9 +- 11.77 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 105.1 +- 10.96 | 96.0 +- 13.42 | 103.2 +- 14.45 | +7.5 +- 21.27 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 83.1 +- 4.91 | 82.5 +- 8.72 | 88.5 +- 36.18 | +7.27 +- 45.3 | | 78b-2t1c-avf-ethip6-ip6base | 86.8 +- 8.19 | 78.1 +- 8.52 | 83.5 +- 18.45 | +6.91 +- 26.34 | | 64b-2t1c-avf-ethip4-ip4base | 78.8 +- 7.71 | 79.7 +- 8.27 | 85.0 +- 17.74 | +6.65 +- 24.86 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 178.9 +- 13.45 | 159.7 +- 11.17 | 168.8 +- 17.16 | +5.7 +- 13.04 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 99.8 +- 4.47 | 92.0 +- 5.87 | 96.6 +- 9.24 | +5.0 +- 12.07 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 114.1 +- 7.46 | 100.4 +- 13.91 | 104.8 +- 10.52 | +4.38 +- 17.85 | | 78b-2t1c-avf-ethip6-ip6scale200k | 129.7 +- 63.58 | 139.7 +- 56.64 | 145.3 +- 69.6 | +4.01 +- 65.27 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 240.1 +- 12.47 | 202.4 +- 11.78 | 210.4 +- 11.29 | +3.95 +- 8.23 | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 142.8 +- 86.81 | 106.2 +- 18.38 | 110.0 +- 46.07 | +3.58 +- 46.94 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 99.0 +- 7.01 | 94.7 +- 8.93 | 97.9 +- 11.69 | +3.38 +- 15.73 | | 78b-2t1c-ethip6-ip6scale20k | 92.3 +- 9.79 | 85.5 +- 12.43 | 87.9 +- 12.56 | +2.81 +- 20.95 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 106.4 +- 5.25 | 101.4 +- 12.58 | 103.3 +- 5.54 | +1.87 +- 13.77 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 87.4 +- 5.6 | 83.2 +- 6.27 | 84.6 +- 7.46 | +1.68 +- 11.79 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 212.5 +- 9.06 | 185.5 +- 15.78 | 187.8 +- 12.17 | +1.24 +- 10.83 | | 64b-2t1c-eth-l2patch | 53.4 +- 3.86 | 49.8 +- 4.29 | 50.4 +- 3.95 | +1.2 +- 11.79 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 98.8 +- 7.57 | 87.6 +- 12.62 | 88.6 +- 10.2 | +1.14 +- 18.65 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 325.9 +- 57.61 | 366.2 +- 85.22 | 370.1 +- 59.04 | +1.06 +- 28.51 | | 64b-2t1c-avf-ethip4-ip4scale200k | 80.0 +- 7.15 | 84.4 +- 15.16 | 85.0 +- 12.74 | +0.71 +- 23.56 | | 64b-2t1c-ethip4-ip4scale20k | 83.0 +- 3.59 | 74.4 +- 4.55 | 74.4 +- 4.86 | +0.0 +- 8.95 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 181.3 +- 17.48 | 152.2 +- 14.38 | 152.0 +- 19.82 | -0.13 +- 16.08 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 204.6 +- 16.18 | 209.8 +- 21.01 | 209.2 +- 18.72 | -0.29 +- 13.39 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 212.8 +- 8.31 | 207.2 +- 12.33 | 206.2 +- 6.89 | -0.48 +- 6.79 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 106.1 +- 11.79 | 99.7 +- 19.6 | 99.2 +- 12.22 | -0.5 +- 23.08 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 74.1 +- 8.08 | 78.3 +- 14.63 | 77.2 +- 10.39 | -1.4 +- 22.7 | | 64b-2t1c-ethip4-ip4base | 98.3 +- 13.65 | 105.6 +- 7.07 | 103.5 +- 6.02 | -1.99 +- 8.7 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 310.6 +- 15.34 | 310.0 +- 19.68 | 301.8 +- 25.45 | -2.65 +- 10.27 | | 64b-2t1c-avf-eth-l2patch | 35.4 +- 3.27 | 39.4 +- 9.0 | 38.3 +- 7.83 | -2.79 +- 29.8 | | 64b-2t1c-eth-l2xcbase | 70.1 +- 4.46 | 65.4 +- 5.23 | 63.5 +- 1.18 | -2.91 +- 7.97 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 248.5 +- 7.53 | 230.0 +- 20.95 | 223.0 +- 8.52 | -3.04 +- 9.58 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 78.5 +- 5.93 | 78.8 +- 10.58 | 74.9 +- 5.82 | -4.95 +- 14.75 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 356.5 +- 20.06 | 357.2 +- 44.9 | 338.9 +- 26.95 | -5.12 +- 14.11 | | 64b-2t1c-avf-ethip4-ip4scale20k | 79.5 +- 9.28 | 83.1 +- 8.61 | 78.7 +- 10.86 | -5.29 +- 16.34 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k-rnd | 502.4 +- 456.72 | 440.0 +- 327.37 | 412.1 +- 306.74 | -6.34 +- 98.57 | | 78b-2t1c-avf-ethip6-ip6scale2m | 107.8 +- 6.58 | 97.8 +- 15.13 | 91.4 +- 12.47 | -6.54 +- 19.27 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 106.8 +- 15.39 | 108.3 +- 16.6 | 101.1 +- 14.21 | -6.65 +- 19.41 | | 64b-2t1c-eth-l2bdscale1mmaclrn | 178.5 +- 53.24 | 146.4 +- 38.11 | 134.2 +- 25.44 | -8.33 +- 29.52 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 221.4 +- 28.73 | 233.8 +- 95.12 | 212.9 +- 46.58 | -8.94 +- 42.06 | | 64b-2t1c-avf-ethip4-ip4scale2m | 96.9 +- 14.29 | 109.5 +- 22.92 | 99.4 +- 19.64 | -9.22 +- 26.13 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 85.9 +- 3.67 | 99.7 +- 37.69 | 86.9 +- 10.71 | -12.84 +- 34.66 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k-rnd | 376.4 +- 377.37 | 456.2 +- 331.63 | 382.2 +- 322.66 | -16.22 +- 93.34 | | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 118.5 +- 12.58 | 123.0 +- 17.26 | 95.4 +- 8.6 | -22.44 +- 12.94 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 209.7 +- 17.68 | 260.3 +- 109.07 | 201.4 +- 17.39 | -22.63 +- 33.1 | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 100.4 +- 32.82 | 104.8 +- 48.14 | 76.9 +- 4.75 | -26.62 +- 34.01 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 178.7 +- 10.89 | 215.3 +- 92.98 | 157.8 +- 26.52 | -26.71 +- 33.97 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k | 279.1 +- 300.62 | 591.7 +- 380.05 | 282.4 +- 165.43 | -52.27 +- 41.49 | +--------------------------------------------------------------+-----------------+-----------------+-----------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210 and rls2302). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2302.0-11 vs 2210.0-11: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.