+--------------------------------------------------------------+---------------+---------------+--------------+------------------------+ | Test Case | 2206.0-10 | 2210.0-11 | 2302.0-11 | 2302.0-11 vs 2210.0-11 | +--------------------------------------------------------------+---------------+---------------+--------------+------------------------+ | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 21.3 +- 2.26 | 24.3 +- 1.89 | 26.2 +- 3.19 | +7.82 +- 15.57 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 22.0 +- 0.82 | 21.4 +- 0.84 | 23.0 +- 1.05 | +7.48 +- 6.5 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 22.7 +- 1.42 | 22.9 +- 2.6 | 24.5 +- 3.03 | +6.99 +- 17.96 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 20.5 +- 1.08 | 20.7 +- 1.34 | 22.1 +- 1.37 | +6.76 +- 9.56 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 23.6 +- 1.96 | 25.8 +- 2.57 | 27.3 +- 4.11 | +5.81 +- 19.11 | | 78b-2t1c-avf-ethip6-ip6base | 19.1 +- 0.99 | 19.6 +- 1.51 | 20.7 +- 2.75 | +5.61 +- 16.21 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 22.2 +- 1.69 | 22.2 +- 1.48 | 23.4 +- 1.43 | +5.41 +- 9.52 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 20.5 +- 0.85 | 20.0 +- 0.67 | 21.0 +- 0.82 | +5.0 +- 5.38 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 23.3 +- 1.25 | 24.4 +- 1.84 | 25.5 +- 2.07 | +4.51 +- 11.57 | | 64b-2t1c-avf-eth-l2patch | 15.4 +- 1.07 | 15.5 +- 0.71 | 16.0 +- 0.82 | +3.23 +- 7.07 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 29.6 +- 2.01 | 31.7 +- 5.62 | 32.7 +- 5.29 | +3.15 +- 24.76 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 26.2 +- 2.94 | 25.9 +- 2.56 | 26.5 +- 2.42 | +2.32 +- 13.75 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 23.6 +- 1.58 | 24.9 +- 1.45 | 25.4 +- 1.17 | +2.01 +- 7.58 | | 64b-2t1c-avf-ethip4-ip4base | 20.7 +- 0.95 | 20.2 +- 0.63 | 20.6 +- 1.35 | +1.98 +- 7.41 | | 64b-2t1c-avf-ethip4-ip4scale20k | 22.9 +- 2.13 | 20.8 +- 1.03 | 21.2 +- 0.92 | +1.92 +- 6.72 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 21.3 +- 1.06 | 20.9 +- 1.1 | 21.3 +- 1.06 | +1.91 +- 7.38 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 20.8 +- 0.79 | 21.4 +- 1.43 | 21.7 +- 2.26 | +1.4 +- 12.56 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 26.9 +- 2.47 | 29.2 +- 2.9 | 29.5 +- 3.34 | +1.03 +- 15.22 | | 78b-2t1c-avf-ethip6-ip6scale20k | 20.4 +- 0.97 | 21.5 +- 1.08 | 21.7 +- 1.34 | +0.93 +- 8.03 | | 78b-2t1c-ethip6-ip6base | 18.9 +- 0.88 | 20.3 +- 1.49 | 20.4 +- 1.51 | +0.49 +- 10.48 | | 78b-2t1c-ethip6-ip6scale20k | 22.9 +- 1.66 | 23.1 +- 1.29 | 23.2 +- 1.55 | +0.43 +- 8.73 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 32.4 +- 6.04 | 32.2 +- 6.23 | 32.3 +- 4.83 | +0.31 +- 24.54 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 36.5 +- 2.17 | 38.7 +- 2.75 | 38.8 +- 2.57 | +0.26 +- 9.75 | | 64b-2t1c-eth-l2patch | 15.9 +- 0.74 | 15.6 +- 0.84 | 15.6 +- 0.52 | +0.0 +- 6.34 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 59.3 +- 7.69 | 60.3 +- 3.5 | 60.2 +- 8.02 | -0.17 +- 14.51 | | 64b-2t1c-ethip4-ip4base | 20.1 +- 0.99 | 20.1 +- 0.88 | 20.0 +- 1.05 | -0.5 +- 6.8 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 38.8 +- 2.57 | 38.3 +- 3.13 | 38.0 +- 2.83 | -0.78 +- 10.96 | | 64b-2t1c-ethip4-ip4scale20k | 21.2 +- 1.03 | 21.1 +- 1.85 | 20.9 +- 1.6 | -0.95 +- 11.52 | | 64b-2t1c-avf-ethip4udp-nat44det-h262144-p63-s16515072 | 30.29 +- 1.8 | 34.38 +- 5.37 | 34.0 +- 3.07 | -1.09 +- 17.85 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 19.5 +- 1.35 | 21.0 +- 1.15 | 20.7 +- 1.25 | -1.43 +- 8.06 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 21.2 +- 1.23 | 22.1 +- 0.99 | 21.7 +- 1.34 | -1.81 +- 7.49 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 38.1 +- 2.08 | 41.7 +- 4.4 | 40.9 +- 4.58 | -1.92 +- 15.09 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 35.7 +- 2.16 | 36.0 +- 1.25 | 35.3 +- 2.41 | -1.94 +- 7.5 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 53.6 +- 2.07 | 54.0 +- 2.87 | 52.9 +- 1.37 | -2.04 +- 5.79 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 39.2 +- 1.32 | 41.8 +- 1.48 | 40.9 +- 2.28 | -2.15 +- 6.46 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 38.4 +- 2.17 | 39.9 +- 4.04 | 38.8 +- 2.57 | -2.76 +- 11.77 | | 64b-2t1c-eth-l2bdbasemaclrn | 19.6 +- 0.7 | 20.7 +- 1.16 | 20.0 +- 0.94 | -3.38 +- 7.07 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 47.9 +- 9.35 | 50.3 +- 8.73 | 48.4 +- 7.0 | -3.78 +- 21.73 | | 64b-2t1c-avf-eth-l2xcbase | 18.8 +- 0.63 | 19.6 +- 1.07 | 18.8 +- 0.92 | -4.08 +- 7.05 | | 64b-2t1c-eth-l2xcbase | 18.3 +- 0.82 | 19.1 +- 0.99 | 18.3 +- 0.67 | -4.19 +- 6.11 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 53.9 +- 5.55 | 58.8 +- 7.66 | 55.6 +- 4.45 | -5.44 +- 14.45 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 37.8 +- 3.43 | 47.1 +- 8.23 | 41.2 +- 3.05 | -12.53 +- 16.59 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 37.3 +- 4.11 | 40.1 +- 7.22 | 34.5 +- 4.86 | -13.97 +- 19.66 | +--------------------------------------------------------------+---------------+---------------+--------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210 and rls2302). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2302.0-11 vs 2210.0-11: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.