+--------------------------------------------------------------+--------------+---------------+--------------+---------------+----------------------+----------------------+ | Test Case | 2101.0-7 | 2106.0-7 | 2106.0-8 | 2110.0-8 | 2106.0-8 vs 2106.0-7 | 2110.0-8 vs 2106.0-8 | +--------------------------------------------------------------+--------------+---------------+--------------+---------------+----------------------+----------------------+ | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 19.3 +- 2.26 | 21.55 +- 3.53 | 20.9 +- 3.67 | 24.8 +- 2.49 | -3.0 +- 23.29 | +18.66 +- 23.97 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 18.2 +- 0.79 | 22.73 +- 1.35 | 21.2 +- 1.32 | 22.7 +- 2.0 | -6.72 +- 8.01 | +7.08 +- 11.55 | | 64b-2t1c-ethip4-ip4scale20k | 18.2 +- 1.48 | 18.73 +- 1.68 | 18.6 +- 0.97 | 19.5 +- 1.27 | -0.68 +- 10.29 | +4.84 +- 8.73 | | 78b-2t1c-ethip6-ip6scale2m | 20.7 +- 1.25 | 22.27 +- 2.0 | 21.6 +- 0.84 | 22.4 +- 1.78 | -3.02 +- 9.51 | +3.7 +- 9.17 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 32.9 +- 4.79 | 38.45 +- 4.18 | 35.9 +- 2.85 | 37.2 +- 2.35 | -6.64 +- 12.56 | +3.62 +- 10.5 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 17.8 +- 1.23 | 20.73 +- 1.01 | 19.9 +- 0.74 | 20.6 +- 1.35 | -3.99 +- 5.88 | +3.52 +- 7.79 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 19.8 +- 2.82 | 29.36 +- 4.43 | 30.1 +- 2.88 | 31.1 +- 4.15 | +2.51 +- 18.33 | +3.32 +- 16.97 | | 64b-2t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 35.8 +- 2.66 | 39.55 +- 1.29 | 38.5 +- 1.18 | 39.6 +- 2.01 | -2.64 +- 4.36 | +2.86 +- 6.1 | | 64b-2t1c-ethip4-ip4base | 16.7 +- 0.48 | 18.36 +- 1.12 | 18.6 +- 1.78 | 19.1 +- 0.57 | +1.29 +- 11.48 | +2.69 +- 10.27 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 39.2 +- 3.16 | 42.27 +- 2.37 | 41.0 +- 1.33 | 42.1 +- 1.6 | -3.01 +- 6.29 | +2.68 +- 5.13 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 38.1 +- 2.28 | 38.0 +- 1.79 | 37.8 +- 2.04 | 38.8 +- 1.69 | -0.53 +- 7.13 | +2.65 +- 7.12 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 17.7 +- 0.95 | 23.36 +- 1.86 | 22.9 +- 2.28 | 23.5 +- 2.42 | -1.98 +- 12.5 | +2.62 +- 14.69 | | 64b-2t1c-avf-eth-l2xcbase | 16.2 +- 0.79 | 18.09 +- 0.94 | 17.3 +- 1.25 | 17.7 +- 0.95 | -4.37 +- 8.53 | +2.31 +- 9.21 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 16.6 +- 0.52 | 20.73 +- 1.01 | 20.7 +- 1.42 | 21.1 +- 1.52 | -0.13 +- 8.39 | +1.93 +- 10.15 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 36.5 +- 2.12 | 40.0 +- 1.0 | 38.7 +- 2.0 | 39.3 +- 1.49 | -3.25 +- 5.56 | +1.55 +- 6.52 | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 16.3 +- 0.67 | 19.18 +- 0.98 | 20.0 +- 1.25 | 20.3 +- 1.7 | +4.27 +- 8.41 | +1.5 +- 10.61 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 36.9 +- 1.97 | 47.82 +- 4.29 | 47.3 +- 4.06 | 48.0 +- 4.14 | -1.08 +- 12.27 | +1.48 +- 12.34 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 31.8 +- 1.48 | 35.0 +- 0.89 | 35.1 +- 1.1 | 35.6 +- 0.84 | +0.29 +- 4.06 | +1.42 +- 3.99 | | 78b-2t1c-ethip6-ip6scale200k-rnd | 18.0 +- 0.82 | 21.64 +- 1.21 | 21.6 +- 1.07 | 21.9 +- 1.2 | -0.17 +- 7.46 | +1.39 +- 7.5 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 34.1 +- 2.42 | 37.36 +- 1.8 | 37.3 +- 2.5 | 37.8 +- 2.97 | -0.17 +- 8.24 | +1.34 +- 10.47 | | 78b-2t1c-ethip6-ip6base | 17.0 +- 1.15 | 19.36 +- 1.03 | 19.5 +- 1.35 | 19.7 +- 1.34 | +0.7 +- 8.8 | +1.03 +- 9.81 | | 64b-2t1c-avf-ethip4-ip4scale2m | 16.0 +- 1.15 | 19.91 +- 1.87 | 20.6 +- 1.07 | 20.8 +- 1.03 | +3.47 +- 11.11 | +0.97 +- 7.27 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 29.7 +- 1.77 | 34.45 +- 1.37 | 34.4 +- 1.51 | 34.6 +- 1.65 | -0.16 +- 5.9 | +0.58 +- 6.5 | | 78b-2t1c-ethip6-ip6scale20k | 18.4 +- 2.84 | 20.27 +- 1.68 | 20.0 +- 1.76 | 20.1 +- 0.88 | -1.35 +- 11.93 | +0.5 +- 9.89 | | 64b-2t1c-eth-l2bdbasemaclrn | 17.6 +- 0.84 | 20.18 +- 0.6 | 20.3 +- 1.16 | 20.4 +- 1.35 | +0.59 +- 6.48 | +0.49 +- 8.78 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k-rnd | NT | 47.67 +- 3.35 | 15.3 +- 0.82 | 15.38 +- 0.52 | -67.9 +- 2.84 | +0.49 +- 6.38 | | 64b-2t1c-ethip4-ip4scale2m-rnd | 19.3 +- 1.7 | 20.45 +- 1.57 | 20.7 +- 1.7 | 20.8 +- 1.62 | +1.2 +- 11.39 | +0.48 +- 11.38 | | 78b-2t1c-avf-ethip6-ip6scale200k | 16.3 +- 1.06 | 20.64 +- 2.16 | 21.1 +- 2.23 | 21.2 +- 1.69 | +2.25 +- 15.21 | +0.47 +- 13.3 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 18.6 +- 1.17 | 25.82 +- 2.6 | 25.1 +- 1.85 | 25.2 +- 1.55 | -2.78 +- 12.14 | +0.4 +- 9.65 | | 64b-2t1c-af-xdp-ethip4-ip4base | NT | 43.33 +- 5.81 | 15.5 +- 0.85 | 15.5 +- 0.53 | -64.23 +- 5.18 | +0.0 +- 6.48 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 17.2 +- 0.42 | 21.64 +- 1.03 | 22.3 +- 1.25 | 22.3 +- 1.34 | +3.07 +- 7.58 | +0.0 +- 8.21 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 16.7 +- 0.67 | 20.18 +- 1.33 | 19.9 +- 0.74 | 19.9 +- 0.57 | -1.4 +- 7.45 | +0.0 +- 4.68 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 16.6 +- 0.97 | 32.36 +- 4.01 | 32.8 +- 3.88 | 32.8 +- 2.9 | +1.35 +- 17.36 | +0.0 +- 14.77 | | 64b-2t1c-eth-l2bdscale1mmaclrn | 19.3 +- 1.42 | 21.36 +- 0.92 | 21.3 +- 1.25 | 21.3 +- 1.16 | -0.3 +- 7.28 | +0.0 +- 8.01 | | 64b-2t1c-eth-l2xcbase | 15.8 +- 1.03 | 17.73 +- 0.79 | 17.7 +- 1.16 | 17.7 +- 0.67 | -0.15 +- 7.9 | +0.0 +- 7.58 | | 64b-2t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 32.3 +- 3.13 | 35.36 +- 1.5 | 35.6 +- 1.26 | 35.6 +- 1.07 | +0.67 +- 5.57 | +0.0 +- 4.66 | | 64b-2t1c-ethip4-ip4scale200k | 17.7 +- 0.67 | 19.36 +- 1.03 | 18.9 +- 1.37 | 18.9 +- 0.99 | -2.39 +- 8.77 | +0.0 +- 8.96 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 17.6 +- 0.7 | 23.64 +- 1.12 | 25.3 +- 2.67 | 25.2 +- 2.35 | +7.04 +- 12.38 | -0.4 +- 14.02 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 17.2 +- 0.42 | 19.64 +- 0.92 | 19.6 +- 0.97 | 19.5 +- 0.85 | -0.19 +- 6.8 | -0.51 +- 6.55 | | 78b-2t1c-avf-ethip6-ip6scale2m | 17.3 +- 1.34 | 23.73 +- 2.05 | 25.4 +- 2.41 | 25.2 +- 2.2 | +7.05 +- 13.76 | -0.79 +- 12.8 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k | NT | 44.22 +- 5.07 | 15.0 +- 0.47 | 14.88 +- 0.64 | -66.08 +- 4.03 | -0.83 +- 5.29 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k | NT | 50.1 +- 3.28 | 15.9 +- 0.88 | 15.75 +- 0.46 | -68.26 +- 2.72 | -0.94 +- 6.18 | | 78b-2t1c-avf-ethip6-ip6scale20k | 16.3 +- 0.67 | 20.18 +- 1.72 | 20.2 +- 0.79 | 20.0 +- 0.94 | +0.09 +- 9.39 | -0.99 +- 6.06 | | 64b-2t1c-avf-ethip4-ip4scale20k | 16.4 +- 1.17 | 19.18 +- 2.4 | 19.1 +- 1.29 | 18.9 +- 1.29 | -0.43 +- 14.15 | -1.05 +- 9.48 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 18.3 +- 1.25 | 24.18 +- 1.72 | 23.9 +- 1.37 | 23.6 +- 1.65 | -1.17 +- 9.03 | -1.26 +- 8.92 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k-rnd | NT | 50.11 +- 3.22 | 15.8 +- 0.92 | 15.5 +- 0.53 | -68.47 +- 2.73 | -1.9 +- 6.63 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 16.6 +- 0.52 | 20.0 +- 1.18 | 20.7 +- 1.83 | 20.3 +- 1.57 | +3.5 +- 11.0 | -1.93 +- 11.51 | | 78b-2t1c-avf-ethip6-ip6base | 15.9 +- 0.99 | 19.73 +- 0.65 | 20.1 +- 1.66 | 19.7 +- 1.34 | +1.89 +- 9.07 | -1.99 +- 10.49 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 16.3 +- 0.48 | 19.0 +- 1.41 | 19.9 +- 1.29 | 19.5 +- 0.97 | +4.74 +- 10.33 | -2.01 +- 8.0 | | 78b-2t1c-ethip6-ip6scale200k | 18.8 +- 1.32 | 21.73 +- 0.9 | 21.5 +- 1.58 | 21.0 +- 1.05 | -1.05 +- 8.36 | -2.33 +- 8.7 | | 64b-2t1c-ethip4-ip4scale2m | 18.7 +- 0.95 | 20.64 +- 1.36 | 21.0 +- 1.7 | 20.5 +- 1.84 | +1.76 +- 10.63 | -2.38 +- 11.8 | | 64b-2t1c-ethip4-ip4scale200k-rnd | 17.7 +- 1.06 | 20.09 +- 0.7 | 20.5 +- 0.85 | 20.0 +- 1.05 | +2.04 +- 5.53 | -2.44 +- 6.54 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 17.7 +- 0.67 | 20.36 +- 1.43 | 20.3 +- 1.57 | 19.8 +- 0.79 | -0.31 +- 10.41 | -2.46 +- 8.47 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 36.8 +- 3.94 | 44.09 +- 3.08 | 44.1 +- 4.38 | 43.0 +- 2.91 | +0.02 +- 12.15 | -2.49 +- 11.72 | | 64b-2t1c-eth-l2patch | 15.5 +- 1.35 | 16.18 +- 1.4 | 15.5 +- 1.08 | 15.1 +- 0.32 | -4.21 +- 10.65 | -2.58 +- 7.09 | | 64b-2t1c-avf-eth-l2patch | 13.9 +- 0.32 | 15.18 +- 1.08 | 15.0 +- 0.67 | 14.6 +- 0.52 | -1.2 +- 8.28 | -2.67 +- 5.53 | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 17.0 +- 0.47 | 21.55 +- 1.21 | 21.9 +- 1.6 | 21.3 +- 1.95 | +1.65 +- 9.36 | -2.74 +- 11.37 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 18.3 +- 0.95 | 27.36 +- 3.11 | 28.5 +- 2.46 | 27.7 +- 1.89 | +4.15 +- 14.86 | -2.81 +- 10.69 | | 64b-2t1c-avf-ethip4-ip4base | 17.2 +- 1.87 | 18.82 +- 0.75 | 19.4 +- 1.07 | 18.8 +- 0.63 | +3.09 +- 7.04 | -3.09 +- 6.28 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 38.1 +- 2.96 | 40.82 +- 2.04 | 39.8 +- 3.05 | 38.5 +- 2.17 | -2.49 +- 8.92 | -3.27 +- 9.2 | | 78b-2t1c-af-xdp-ethip6-ip6base | NT | 44.0 +- 5.46 | 15.9 +- 0.99 | 15.25 +- 0.46 | -63.86 +- 5.02 | -4.09 +- 6.67 | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 16.3 +- 0.48 | 21.09 +- 1.22 | 21.7 +- 2.31 | 20.8 +- 0.63 | +2.89 +- 12.48 | -4.15 +- 10.62 | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 17.4 +- 1.35 | 21.73 +- 2.05 | 22.6 +- 3.37 | 21.6 +- 2.37 | +4.02 +- 18.38 | -4.42 +- 17.7 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 33.1 +- 1.37 | 42.91 +- 2.63 | 42.4 +- 2.46 | 40.3 +- 4.14 | -1.19 +- 8.33 | -4.95 +- 11.21 | | 64b-2t1c-avf-ethip4-ip4scale200k | 16.4 +- 0.7 | 19.36 +- 1.36 | 20.2 +- 1.4 | 19.0 +- 0.67 | +4.32 +- 10.29 | -5.94 +- 7.3 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 33.4 +- 2.22 | 38.09 +- 1.14 | 38.0 +- 1.76 | 35.5 +- 0.97 | -0.24 +- 5.5 | -6.58 +- 5.03 | | 78b-2t1c-ethip6-ip6scale2m-rnd | 21.0 +- 1.05 | 23.82 +- 2.23 | 24.0 +- 1.76 | 22.4 +- 1.71 | +0.76 +- 11.99 | -6.67 +- 9.9 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 16.6 +- 1.51 | 20.0 +- 1.61 | 20.7 +- 1.49 | 19.3 +- 1.77 | +3.5 +- 11.2 | -6.76 +- 10.87 | | 64b-2t1c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir | 25.0 +- 2.0 | 40.91 +- 4.01 | 41.7 +- 2.67 | 37.0 +- 2.11 | +1.93 +- 11.94 | -11.27 +- 7.6 | +--------------------------------------------------------------+--------------+---------------+--------------+---------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "7" for CSIT rls2106, "8" for CSIT rls2110). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2106.0-8 vs 2106.0-7: Compares CSIT environment current vs previous with previous VPP code. 2110.0-8 vs 2106.0-8: Compares VPP code current vs previous in the current CSIT environment.