+--------------------------------------------------------------+-----------------+-----------------+------------------+------------------------+ | Test Case | 2206.0-10 | 2210.0-11 | 2302.0-11 | 2302.0-11 vs 2210.0-11 | +--------------------------------------------------------------+-----------------+-----------------+------------------+------------------------+ | 64b-2t1c-af-xdp-ethip4-ip4base | 210.3 +- 115.56 | 350.4 +- 177.95 | 676.08 +- 303.75 | +92.95 +- 130.83 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k-rnd | 330.8 +- 319.0 | 409.4 +- 274.6 | 762.58 +- 339.08 | +86.27 +- 149.9 | | 78b-2t1c-af-xdp-ethip6-ip6base | 277.4 +- 283.41 | 360.1 +- 185.35 | 604.25 +- 310.98 | +67.8 +- 122.14 | | 78b-2t1c-avf-ethip6-ip6base | 73.9 +- 20.36 | 63.8 +- 6.05 | 74.92 +- 27.71 | +17.42 +- 44.83 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 82.2 +- 29.99 | 66.3 +- 3.92 | 74.58 +- 13.26 | +12.49 +- 21.08 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k-rnd | 358.6 +- 329.04 | 501.8 +- 410.18 | 544.83 +- 338.72 | +8.58 +- 111.5 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 73.9 +- 20.47 | 66.3 +- 4.92 | 71.67 +- 8.77 | +8.09 +- 15.48 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 66.2 +- 21.38 | 54.5 +- 4.25 | 58.0 +- 10.41 | +6.42 +- 20.82 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 182.2 +- 24.23 | 166.9 +- 7.46 | 175.75 +- 8.3 | +5.3 +- 6.85 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 226.7 +- 20.39 | 200.7 +- 8.87 | 211.25 +- 19.84 | +5.26 +- 10.93 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 199.5 +- 12.66 | 186.2 +- 12.55 | 195.5 +- 16.01 | +4.99 +- 11.14 | | 64b-2t1c-eth-l2bdscale1mmaclrn | 87.1 +- 26.6 | 81.7 +- 13.22 | 85.58 +- 41.22 | +4.75 +- 53.22 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 186.0 +- 27.86 | 154.5 +- 8.49 | 161.83 +- 17.93 | +4.75 +- 12.95 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 68.8 +- 23.83 | 59.1 +- 4.41 | 61.67 +- 3.98 | +4.34 +- 10.3 | | 64b-2t1c-ethip4-ip4base | 69.9 +- 26.74 | 57.6 +- 4.99 | 59.33 +- 8.58 | +3.01 +- 17.37 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 70.6 +- 24.54 | 62.8 +- 8.24 | 64.58 +- 7.19 | +2.84 +- 17.7 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 189.0 +- 37.0 | 159.4 +- 15.81 | 163.33 +- 10.17 | +2.47 +- 12.0 | | 78b-2t1c-avf-ethip6-ip6scale20k | 72.6 +- 18.98 | 69.1 +- 18.9 | 70.67 +- 33.46 | +2.27 +- 55.92 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 155.1 +- 16.69 | 134.5 +- 16.03 | 136.5 +- 16.65 | +1.49 +- 17.31 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 76.5 +- 23.35 | 72.9 +- 7.31 | 73.5 +- 6.39 | +0.82 +- 13.38 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 203.3 +- 22.68 | 193.5 +- 8.09 | 194.67 +- 7.85 | +0.6 +- 5.84 | | 64b-2t1c-eth-l2xcbase | 57.4 +- 23.46 | 45.0 +- 2.75 | 45.08 +- 3.26 | +0.19 +- 9.48 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 103.4 +- 21.98 | 86.1 +- 14.88 | 86.0 +- 6.15 | -0.12 +- 18.68 | | 64b-2t1c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir | 160.7 +- 34.2 | 144.1 +- 25.87 | 143.5 +- 54.95 | -0.42 +- 42.12 | | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 123.5 +- 47.48 | 118.9 +- 51.16 | 118.17 +- 55.81 | -0.62 +- 63.5 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 191.5 +- 22.29 | 176.3 +- 7.42 | 175.17 +- 11.67 | -0.64 +- 7.83 | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 79.7 +- 9.29 | 71.9 +- 9.36 | 71.42 +- 4.4 | -0.67 +- 14.31 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 173.0 +- 23.0 | 158.0 +- 10.27 | 156.25 +- 13.84 | -1.11 +- 10.87 | | 64b-2t1c-avf-ethip4-ip4scale200k | 73.0 +- 24.07 | 60.4 +- 11.99 | 59.42 +- 9.12 | -1.63 +- 24.69 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 164.3 +- 31.2 | 155.0 +- 7.73 | 152.42 +- 8.06 | -1.67 +- 7.15 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 76.6 +- 21.4 | 64.5 +- 5.78 | 63.42 +- 4.56 | -1.68 +- 11.3 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 131.4 +- 15.81 | 124.9 +- 11.84 | 122.42 +- 17.45 | -1.99 +- 16.78 | | 64b-2t1c-eth-l2patch | 44.7 +- 24.57 | 32.3 +- 2.67 | 31.5 +- 2.94 | -2.48 +- 12.15 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 154.3 +- 29.07 | 136.4 +- 9.87 | 132.58 +- 4.25 | -2.8 +- 7.69 | | 64b-2t1c-eth-l2bdbasemaclrn | 67.8 +- 17.78 | 58.6 +- 2.84 | 56.5 +- 5.09 | -3.58 +- 9.86 | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 72.4 +- 19.44 | 66.8 +- 8.59 | 63.83 +- 6.48 | -4.44 +- 15.65 | | 64b-2t1c-avf-ethip4-ip4base | 71.6 +- 20.51 | 69.7 +- 9.35 | 66.58 +- 7.45 | -4.47 +- 16.69 | | 64b-2t1c-avf-eth-l2xcbase | 50.9 +- 23.19 | 43.3 +- 5.21 | 41.33 +- 4.72 | -4.54 +- 15.83 | | 78b-2t1c-avf-ethip6-ip6scale2m | 139.5 +- 84.39 | 113.9 +- 59.71 | 108.58 +- 64.33 | -4.67 +- 75.41 | | 78b-2t1c-ethip6-ip6base | 73.2 +- 24.14 | 63.5 +- 4.35 | 60.5 +- 5.37 | -4.72 +- 10.68 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 149.7 +- 23.75 | 137.5 +- 9.52 | 130.83 +- 15.09 | -4.85 +- 12.8 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 192.6 +- 27.59 | 165.0 +- 18.0 | 156.33 +- 14.64 | -5.25 +- 13.62 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 80.9 +- 27.73 | 71.7 +- 4.19 | 67.92 +- 4.68 | -5.28 +- 8.56 | | 64b-2t1c-avf-eth-l2patch | 30.8 +- 2.49 | 30.6 +- 5.13 | 28.75 +- 2.09 | -6.05 +- 17.16 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 85.8 +- 18.01 | 87.2 +- 10.03 | 81.83 +- 5.8 | -6.15 +- 12.68 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k | 516.0 +- 414.65 | 375.2 +- 277.53 | 350.67 +- 209.18 | -6.54 +- 88.81 | | 64b-2t1c-avf-ethip4-ip4scale2m | 83.8 +- 25.01 | 73.4 +- 10.92 | 68.58 +- 11.1 | -6.56 +- 20.54 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 91.1 +- 27.13 | 80.2 +- 11.06 | 74.08 +- 5.95 | -7.63 +- 14.74 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 92.6 +- 33.38 | 79.8 +- 13.15 | 73.58 +- 4.08 | -7.79 +- 16.03 | | 64b-2t1c-avf-ethip4-ip4scale20k | 71.7 +- 28.05 | 60.9 +- 6.15 | 55.67 +- 3.63 | -8.59 +- 10.99 | | 64b-2t1c-ethip4-ip4scale20k | 70.3 +- 26.65 | 58.0 +- 4.52 | 52.83 +- 4.24 | -8.91 +- 10.19 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 69.6 +- 24.13 | 60.6 +- 16.48 | 54.0 +- 4.59 | -10.89 +- 25.39 | | 78b-2t1c-ethip6-ip6scale20k | 78.2 +- 28.23 | 67.6 +- 11.49 | 59.0 +- 6.11 | -12.72 +- 17.37 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 82.2 +- 22.0 | 82.0 +- 6.15 | 70.0 +- 6.67 | -14.63 +- 10.35 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k | 209.6 +- 184.13 | 578.7 +- 338.85 | 477.0 +- 332.41 | -17.57 +- 75.02 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 131.6 +- 61.08 | 186.6 +- 152.88 | 145.17 +- 114.77 | -22.2 +- 88.58 | | 78b-2t1c-avf-ethip6-ip6scale200k | 119.4 +- 62.79 | 167.4 +- 64.16 | 127.0 +- 69.61 | -24.13 +- 50.74 | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 131.4 +- 70.31 | 171.7 +- 66.41 | 129.83 +- 74.28 | -24.38 +- 52.22 | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 101.2 +- 32.95 | 136.1 +- 60.97 | 102.17 +- 48.65 | -24.93 +- 49.08 | +--------------------------------------------------------------+-----------------+-----------------+------------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 2n-icx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210 and rls2302). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2302.0-11 vs 2210.0-11: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.