+--------------------------------------------------------------+---------------+---------------+--------------+---------------+----------------------+----------------------+ | Test Case | 2106.0-8 | 2110.0-8 | 2110.0-9 | 2202.0-9 | 2110.0-9 vs 2110.0-8 | 2202.0-9 vs 2110.0-9 | +--------------------------------------------------------------+---------------+---------------+--------------+---------------+----------------------+----------------------+ | 78b-2t1c-ethip6-ip6scale20k | 26.3 +- 3.37 | 25.6 +- 4.65 | 21.3 +- 2.16 | 27.8 +- 1.81 | -16.8 +- 17.31 | +30.52 +- 15.75 | | 64b-2t1c-ethip4-ip4base | 21.6 +- 0.97 | 21.4 +- 0.84 | 22.0 +- 1.33 | 24.4 +- 3.31 | +2.8 +- 7.43 | +10.91 +- 16.46 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 28.5 +- 3.63 | 30.6 +- 2.37 | 29.7 +- 2.58 | 32.5 +- 4.5 | -2.94 +- 11.3 | +9.43 +- 17.9 | | 78b-2t1c-avf-ethip6-ip6base | 22.2 +- 2.15 | 20.5 +- 0.85 | 20.6 +- 0.84 | 22.4 +- 1.84 | +0.49 +- 5.85 | +8.74 +- 9.97 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 28.1 +- 3.0 | 27.5 +- 1.58 | 28.4 +- 2.67 | 30.0 +- 4.11 | +3.27 +- 11.4 | +5.63 +- 17.56 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 23.2 +- 1.4 | 19.9 +- 1.29 | 21.0 +- 1.7 | 21.9 +- 0.99 | +5.53 +- 10.93 | +4.29 +- 9.68 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 30.5 +- 2.17 | 33.0 +- 4.52 | 32.2 +- 2.53 | 33.5 +- 2.95 | -2.42 +- 15.41 | +4.04 +- 12.29 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 23.3 +- 0.95 | 23.6 +- 2.27 | 23.1 +- 0.99 | 24.0 +- 1.15 | -2.12 +- 10.32 | +3.9 +- 6.71 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 24.9 +- 1.2 | 25.1 +- 0.74 | 25.5 +- 0.85 | 26.0 +- 2.45 | +1.59 +- 4.51 | +1.96 +- 10.19 | | 64b-2t1c-avf-ethip4-ip4scale20k | 22.6 +- 0.97 | 22.8 +- 0.79 | 22.5 +- 0.85 | 22.9 +- 1.37 | -1.32 +- 5.05 | +1.78 +- 7.2 | | 64b-2t1c-avf-ethip4udp-nat44det-h262144-p63-s16515072 | 34.0 +- 4.55 | 32.2 +- 2.53 | 31.3 +- 3.33 | 31.8 +- 4.18 | -2.8 +- 12.87 | +1.6 +- 17.2 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 53.2 +- 4.49 | 50.5 +- 2.42 | 50.5 +- 4.28 | 51.3 +- 5.4 | +0.0 +- 9.72 | +1.58 +- 13.72 | | 64b-2t1c-avf-eth-l2patch | 17.2 +- 0.92 | 16.9 +- 0.88 | 16.5 +- 0.71 | 16.7 +- 0.95 | -2.37 +- 6.56 | +1.21 +- 7.2 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 46.9 +- 4.65 | 46.0 +- 3.46 | 44.1 +- 1.91 | 44.2 +- 3.52 | -4.13 +- 8.33 | +0.23 +- 9.09 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 23.1 +- 0.99 | 23.2 +- 1.48 | 23.1 +- 1.2 | 23.0 +- 0.82 | -0.43 +- 8.17 | -0.43 +- 6.25 | | 64b-2t1c-avf-ethip4-ip4base | 22.1 +- 0.99 | 21.9 +- 0.32 | 21.9 +- 0.74 | 21.8 +- 0.92 | +0.0 +- 3.67 | -0.46 +- 5.37 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 44.3 +- 2.54 | 45.2 +- 2.39 | 44.5 +- 2.12 | 44.2 +- 1.87 | -1.55 +- 7.02 | -0.67 +- 6.34 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 26.2 +- 2.25 | 28.1 +- 2.38 | 26.2 +- 1.87 | 25.8 +- 2.53 | -6.76 +- 10.33 | -1.53 +- 11.95 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 70.1 +- 11.57 | 67.2 +- 11.33 | 68.2 +- 8.35 | 66.9 +- 16.08 | +1.49 +- 21.15 | -1.91 +- 26.46 | | 78b-2t1c-avf-ethip6-ip6scale20k | 22.8 +- 0.92 | 22.9 +- 1.2 | 23.0 +- 0.94 | 22.5 +- 0.53 | +0.44 +- 6.67 | -2.17 +- 4.62 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 25.9 +- 0.74 | 26.5 +- 1.43 | 26.3 +- 1.25 | 25.4 +- 0.7 | -0.75 +- 7.15 | -3.42 +- 5.31 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 25.4 +- 1.71 | 25.9 +- 1.66 | 26.2 +- 1.62 | 25.3 +- 2.26 | +1.16 +- 9.02 | -3.44 +- 10.5 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 31.4 +- 2.95 | 31.4 +- 3.92 | 31.8 +- 2.78 | 30.7 +- 2.91 | +1.27 +- 15.44 | -3.46 +- 12.45 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 22.4 +- 0.97 | 22.2 +- 1.03 | 22.4 +- 0.84 | 21.6 +- 0.7 | +0.9 +- 6.04 | -3.57 +- 4.79 | | 64b-2t1c-eth-l2xcbase | 20.1 +- 0.32 | 20.3 +- 0.82 | 20.1 +- 0.57 | 19.3 +- 0.48 | -0.99 +- 4.89 | -3.98 +- 3.62 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 29.4 +- 2.72 | 31.6 +- 4.53 | 31.8 +- 2.74 | 30.2 +- 3.74 | +0.63 +- 16.82 | -5.03 +- 14.32 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 21.9 +- 1.91 | 23.1 +- 0.88 | 23.3 +- 1.06 | 22.1 +- 0.32 | +0.87 +- 5.97 | -5.15 +- 4.52 | | 64b-2t1c-avf-eth-l2xcbase | 21.4 +- 0.52 | 21.7 +- 1.06 | 22.1 +- 0.88 | 20.9 +- 0.57 | +1.84 +- 6.4 | -5.43 +- 4.54 | | 64b-2t1c-eth-l2bdbasemaclrn | 22.4 +- 0.7 | 22.6 +- 0.84 | 22.1 +- 0.74 | 20.9 +- 0.99 | -2.21 +- 4.9 | -5.43 +- 5.5 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 60.6 +- 5.74 | 60.2 +- 7.8 | 62.0 +- 5.94 | 58.5 +- 2.55 | +2.99 +- 16.6 | -5.65 +- 9.94 | | 64b-2t1c-ethip4-ip4scale20k | 22.0 +- 3.46 | 23.5 +- 1.65 | 24.1 +- 0.99 | 22.7 +- 1.34 | +2.55 +- 8.35 | -5.81 +- 6.78 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 23.2 +- 0.79 | 22.5 +- 0.85 | 23.1 +- 1.6 | 21.7 +- 2.26 | +2.67 +- 8.08 | -6.06 +- 11.75 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 25.3 +- 0.67 | 25.2 +- 0.79 | 25.4 +- 0.97 | 23.6 +- 0.97 | +0.79 +- 4.97 | -7.09 +- 5.19 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 48.4 +- 2.17 | 51.3 +- 1.83 | 50.5 +- 2.55 | 46.7 +- 5.19 | -1.56 +- 6.08 | -7.52 +- 11.28 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 25.4 +- 1.35 | 24.5 +- 0.71 | 25.2 +- 0.63 | 23.3 +- 1.77 | +2.86 +- 3.93 | -7.54 +- 7.39 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 46.1 +- 2.38 | 44.0 +- 2.4 | 43.9 +- 1.52 | 40.4 +- 2.12 | -0.23 +- 6.46 | -7.97 +- 5.79 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 67.7 +- 2.58 | 69.9 +- 3.54 | 67.0 +- 1.56 | 61.6 +- 4.67 | -4.15 +- 5.35 | -8.06 +- 7.29 | | 64b-2t1c-eth-l2patch | 17.8 +- 0.63 | 16.8 +- 1.4 | 16.7 +- 1.25 | 15.2 +- 0.42 | -0.6 +- 11.13 | -8.98 +- 7.27 | | 78b-2t1c-ethip6-ip6base | 21.6 +- 0.84 | 23.7 +- 1.89 | 23.0 +- 1.41 | 20.4 +- 0.97 | -2.95 +- 9.77 | -11.3 +- 6.88 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 43.2 +- 1.48 | 44.6 +- 1.9 | 44.0 +- 1.63 | 37.8 +- 2.25 | -1.35 +- 5.57 | -14.09 +- 6.03 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 47.6 +- 2.91 | 49.3 +- 2.21 | 48.5 +- 3.27 | 41.4 +- 1.51 | -1.62 +- 7.98 | -14.64 +- 6.55 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 52.3 +- 1.49 | 54.2 +- 1.93 | 54.5 +- 1.18 | 46.5 +- 3.03 | +0.55 +- 4.19 | -14.68 +- 5.85 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 45.3 +- 1.64 | 45.9 +- 2.18 | 47.1 +- 1.73 | 39.8 +- 1.23 | +2.61 +- 6.17 | -15.5 +- 4.05 | +--------------------------------------------------------------+---------------+---------------+--------------+---------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "8" for CSIT rls2110, "9" for CSIT rls2202). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2110.0-9 vs 2110.0-8: Compares CSIT environment current vs previous with previous VPP code. 2202.0-9 vs 2110.0-9: Compares VPP code current vs previous in the current CSIT environment.