+--------------------------------------------------------------+------------------+-----------------+-----------------+------------------------+ | Test Case | 2206.0-10 | 2210.0-11 | 2302.0-11 | 2302.0-11 vs 2210.0-11 | +--------------------------------------------------------------+------------------+-----------------+-----------------+------------------------+ | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 173.8 +- 109.04 | 106.9 +- 8.33 | 128.2 +- 31.85 | +19.93 +- 31.23 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 183.6 +- 59.15 | 158.5 +- 12.66 | 186.9 +- 23.34 | +17.92 +- 17.48 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 285.3 +- 53.92 | 249.5 +- 34.72 | 286.0 +- 40.14 | +14.63 +- 22.66 | | 64b-2t1c-avf-eth-l2xcbase | 127.3 +- 115.43 | 66.5 +- 2.99 | 75.7 +- 15.11 | +13.83 +- 23.3 | | 64b-2t1c-avf-ethip4udp-nat44det-h262144-p63-s16515072 | 242.43 +- 61.31 | 238.88 +- 52.41 | 265.88 +- 44.27 | +11.3 +- 30.65 | | 78b-2t1c-avf-ethip6-ip6scale20k | 95.4 +- 5.17 | 99.6 +- 4.86 | 109.9 +- 18.0 | +10.34 +- 18.86 | | 78b-2t1c-ethip6-ip6scale20k | 128.6 +- 16.5 | 115.4 +- 11.92 | 126.8 +- 28.61 | +9.88 +- 27.26 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 254.5 +- 74.62 | 231.8 +- 14.47 | 248.5 +- 29.77 | +7.2 +- 14.48 | | 64b-2t1c-avf-ethip4-ip4scale20k | 198.1 +- 130.69 | 96.1 +- 4.89 | 102.8 +- 7.8 | +6.97 +- 9.77 | | 78b-2t1c-avf-ethip6-ip6base | 124.7 +- 85.6 | 100.2 +- 6.34 | 105.5 +- 6.59 | +5.29 +- 9.36 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 227.1 +- 23.46 | 235.5 +- 38.62 | 247.1 +- 30.43 | +4.93 +- 21.52 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 190.2 +- 174.46 | 124.1 +- 11.05 | 130.0 +- 12.88 | +4.75 +- 13.95 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 326.2 +- 68.37 | 318.6 +- 30.43 | 333.1 +- 25.75 | +4.55 +- 12.85 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 150.4 +- 101.09 | 99.0 +- 5.62 | 102.0 +- 11.08 | +3.03 +- 12.62 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 104.7 +- 6.55 | 112.3 +- 23.12 | 115.6 +- 22.88 | +2.94 +- 29.4 | | 78b-2t1c-ethip6-ip6base | 121.1 +- 4.28 | 118.1 +- 6.28 | 121.0 +- 6.99 | +2.46 +- 8.05 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 194.8 +- 114.44 | 122.6 +- 6.42 | 125.6 +- 13.94 | +2.45 +- 12.57 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 427.6 +- 58.02 | 410.2 +- 42.86 | 417.1 +- 36.59 | +1.68 +- 13.87 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 161.3 +- 84.86 | 119.0 +- 12.88 | 120.2 +- 10.73 | +1.01 +- 14.17 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 140.7 +- 69.95 | 116.5 +- 5.1 | 117.5 +- 5.08 | +0.86 +- 6.21 | | 64b-2t1c-avf-ethip4-ip4base | 105.7 +- 6.93 | 100.5 +- 4.01 | 100.5 +- 3.1 | +0.0 +- 5.04 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 98.6 +- 1.96 | 95.8 +- 5.05 | 95.8 +- 5.03 | +0.0 +- 7.44 | | 64b-2t1c-ethip4-ip4base | 126.6 +- 8.18 | 126.3 +- 5.5 | 126.2 +- 6.39 | -0.08 +- 6.67 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 245.5 +- 109.47 | 164.8 +- 15.96 | 164.1 +- 20.75 | -0.42 +- 15.86 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 204.2 +- 97.54 | 138.3 +- 15.49 | 137.5 +- 12.31 | -0.58 +- 14.26 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 153.6 +- 68.81 | 128.1 +- 12.24 | 126.5 +- 9.58 | -1.25 +- 12.04 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 224.0 +- 12.34 | 242.7 +- 21.89 | 237.4 +- 18.39 | -2.18 +- 11.63 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 147.2 +- 104.06 | 99.9 +- 7.2 | 97.7 +- 3.5 | -2.2 +- 7.87 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 139.9 +- 70.65 | 127.3 +- 11.65 | 121.9 +- 7.85 | -4.24 +- 10.72 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 222.3 +- 51.33 | 203.4 +- 13.08 | 194.4 +- 12.58 | -4.42 +- 8.72 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 171.8 +- 24.42 | 177.7 +- 34.08 | 168.3 +- 38.44 | -5.29 +- 28.25 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 306.2 +- 139.99 | 262.2 +- 46.67 | 246.7 +- 17.64 | -5.91 +- 18.05 | | 64b-2t1c-eth-l2patch | 110.3 +- 124.36 | 58.8 +- 17.81 | 55.2 +- 4.24 | -6.12 +- 29.33 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 268.9 +- 89.76 | 234.5 +- 14.68 | 220.1 +- 9.64 | -6.14 +- 7.17 | | 64b-2t1c-avf-eth-l2patch | 101.7 +- 128.9 | 38.4 +- 7.52 | 35.7 +- 5.79 | -7.03 +- 23.64 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 259.3 +- 15.94 | 242.5 +- 14.22 | 224.4 +- 21.11 | -7.46 +- 10.26 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 215.0 +- 83.07 | 175.5 +- 22.38 | 162.4 +- 23.46 | -7.46 +- 17.83 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 138.9 +- 16.11 | 137.3 +- 19.62 | 127.0 +- 5.1 | -7.5 +- 13.73 | | 64b-2t1c-eth-l2bdbasemaclrn | 121.4 +- 57.95 | 108.2 +- 12.88 | 97.6 +- 7.6 | -9.8 +- 12.83 | | 64b-2t1c-eth-l2xcbase | 118.4 +- 76.45 | 97.7 +- 2.5 | 87.3 +- 7.13 | -10.64 +- 7.65 | | 64b-2t1c-ethip4-ip4scale20k | 158.9 +- 97.92 | 135.5 +- 34.64 | 120.7 +- 6.15 | -10.92 +- 23.22 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 142.5 +- 67.24 | 126.0 +- 6.72 | 111.6 +- 6.02 | -11.43 +- 6.72 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 231.8 +- 78.2 | 242.0 +- 65.98 | 209.9 +- 8.41 | -13.26 +- 23.9 | +--------------------------------------------------------------+------------------+-----------------+-----------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210 and rls2302). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2302.0-11 vs 2210.0-11: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.