+--------------------------------------------------------------+--------------+---------------+--------------+--------------+----------------------+----------------------+ | Test Case | 2106.0-8 | 2110.0-8 | 2110.0-9 | 2202.0-9 | 2110.0-9 vs 2110.0-8 | 2202.0-9 vs 2110.0-9 | +--------------------------------------------------------------+--------------+---------------+--------------+--------------+----------------------+----------------------+ | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 37.3 +- 2.5 | 37.8 +- 2.97 | 37.0 +- 1.89 | 42.8 +- 6.41 | -2.12 +- 9.18 | +15.68 +- 18.3 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 20.7 +- 1.49 | 19.3 +- 1.77 | 19.6 +- 2.07 | 21.8 +- 1.48 | +1.55 +- 14.18 | +11.22 +- 13.93 | | 64b-2t1c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir | 41.7 +- 2.67 | 37.0 +- 2.11 | 37.1 +- 2.13 | 40.1 +- 4.31 | +0.27 +- 8.11 | +8.09 +- 13.16 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 19.6 +- 0.97 | 19.5 +- 0.85 | 19.7 +- 0.95 | 20.7 +- 2.58 | +1.03 +- 6.56 | +5.08 +- 14.06 | | 78b-2t1c-ethip6-ip6base | 19.5 +- 1.35 | 19.7 +- 1.34 | 19.7 +- 1.64 | 20.4 +- 1.07 | +0.0 +- 10.73 | +3.55 +- 10.19 | | 64b-2t1c-ethip4-ip4scale20k | 18.6 +- 0.97 | 19.5 +- 1.27 | 19.2 +- 1.03 | 19.8 +- 1.55 | -1.54 +- 8.31 | +3.12 +- 9.79 | | 64b-2t1c-avf-ethip4-ip4scale2m | 20.6 +- 1.07 | 20.8 +- 1.03 | 20.0 +- 0.67 | 20.6 +- 2.67 | -3.85 +- 5.75 | +3.0 +- 13.81 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 25.1 +- 1.85 | 25.2 +- 1.55 | 25.1 +- 2.02 | 25.8 +- 2.25 | -0.4 +- 10.1 | +2.79 +- 12.21 | | 64b-2t1c-eth-l2patch | 15.5 +- 1.08 | 15.1 +- 0.32 | 14.6 +- 0.52 | 15.0 +- 0.82 | -3.31 +- 3.97 | +2.74 +- 6.67 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 32.8 +- 3.88 | 32.8 +- 2.9 | 31.6 +- 2.91 | 32.4 +- 3.84 | -3.66 +- 12.3 | +2.53 +- 15.38 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 38.0 +- 1.76 | 35.5 +- 0.97 | 37.5 +- 1.72 | 38.3 +- 3.56 | +5.63 +- 5.63 | +2.13 +- 10.58 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 19.9 +- 1.29 | 19.5 +- 0.97 | 19.3 +- 0.67 | 19.7 +- 1.57 | -1.03 +- 6.03 | +2.07 +- 8.87 | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 20.0 +- 1.25 | 20.3 +- 1.7 | 19.4 +- 0.97 | 19.7 +- 1.57 | -4.43 +- 9.32 | +1.55 +- 9.53 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 20.3 +- 1.57 | 19.8 +- 0.79 | 20.3 +- 1.16 | 20.6 +- 1.17 | +2.53 +- 7.14 | +1.48 +- 8.19 | | 78b-2t1c-avf-ethip6-ip6base | 20.1 +- 1.66 | 19.7 +- 1.34 | 19.9 +- 1.45 | 20.0 +- 1.41 | +1.02 +- 10.06 | +0.5 +- 10.2 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 28.5 +- 2.46 | 27.7 +- 1.89 | 28.7 +- 2.75 | 28.7 +- 4.3 | +3.61 +- 12.19 | +0.0 +- 17.77 | | 64b-2t1c-avf-eth-l2patch | 15.0 +- 0.67 | 14.6 +- 0.52 | 14.9 +- 0.74 | 14.8 +- 1.14 | +2.05 +- 6.21 | -0.67 +- 9.07 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 20.7 +- 1.42 | 21.1 +- 1.52 | 20.9 +- 1.2 | 20.7 +- 1.34 | -0.95 +- 9.13 | -0.96 +- 8.55 | | 64b-2t1c-avf-ethip4-ip4scale200k | 20.2 +- 1.4 | 19.0 +- 0.67 | 18.9 +- 1.2 | 18.7 +- 0.82 | -0.53 +- 7.2 | -1.06 +- 7.63 | | 64b-2t1c-ethip4-ip4base | 18.6 +- 1.78 | 19.1 +- 0.57 | 18.8 +- 1.14 | 18.6 +- 1.17 | -1.57 +- 6.62 | -1.06 +- 8.64 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 42.4 +- 2.46 | 40.3 +- 4.14 | 40.8 +- 3.68 | 40.3 +- 2.5 | +1.24 +- 13.83 | -1.23 +- 10.8 | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 21.7 +- 2.31 | 20.8 +- 0.63 | 22.7 +- 2.58 | 22.4 +- 1.65 | +9.13 +- 12.86 | -1.32 +- 13.37 | | 64b-2t1c-eth-l2bdscale1mmaclrn | 21.3 +- 1.25 | 21.3 +- 1.16 | 21.7 +- 1.06 | 21.4 +- 0.7 | +1.88 +- 7.45 | -1.38 +- 5.79 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 23.9 +- 1.37 | 23.6 +- 1.65 | 23.3 +- 1.7 | 22.9 +- 1.2 | -1.27 +- 9.98 | -1.72 +- 8.83 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 20.7 +- 1.83 | 20.3 +- 1.57 | 19.6 +- 0.97 | 19.2 +- 1.03 | -3.45 +- 8.84 | -2.04 +- 7.15 | | 64b-2t1c-avf-ethip4-ip4scale20k | 19.1 +- 1.29 | 18.9 +- 1.29 | 19.4 +- 0.84 | 19.0 +- 0.67 | +2.65 +- 8.29 | -2.06 +- 5.47 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k | 15.9 +- 0.88 | 15.75 +- 0.46 | 15.8 +- 0.42 | 15.4 +- 0.97 | +0.32 +- 3.98 | -2.53 +- 6.64 | | 78b-2t1c-af-xdp-ethip6-ip6base | 15.9 +- 0.99 | 15.25 +- 0.46 | 15.6 +- 0.7 | 15.2 +- 0.42 | +2.3 +- 5.54 | -2.56 +- 5.14 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k-rnd | 15.8 +- 0.92 | 15.5 +- 0.53 | 15.6 +- 0.7 | 15.2 +- 0.63 | +0.65 +- 5.69 | -2.56 +- 5.96 | | 78b-2t1c-avf-ethip6-ip6scale20k | 20.2 +- 0.79 | 20.0 +- 0.94 | 20.7 +- 1.34 | 20.1 +- 1.73 | +3.5 +- 8.28 | -2.9 +- 10.45 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 19.9 +- 0.74 | 19.9 +- 0.57 | 19.7 +- 0.67 | 19.1 +- 0.88 | -1.01 +- 4.41 | -3.05 +- 5.55 | | 78b-2t1c-avf-ethip6-ip6scale2m | 25.4 +- 2.41 | 25.2 +- 2.2 | 24.8 +- 2.82 | 23.9 +- 2.13 | -1.59 +- 14.11 | -3.63 +- 13.93 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k | 15.0 +- 0.47 | 14.88 +- 0.64 | 15.8 +- 0.63 | 15.2 +- 0.79 | +6.22 +- 6.25 | -3.8 +- 6.31 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 37.8 +- 2.04 | 38.8 +- 1.69 | 36.7 +- 1.64 | 35.1 +- 1.37 | -5.41 +- 5.89 | -4.36 +- 5.67 | | 64b-2t1c-af-xdp-ethip4-ip4base | 15.5 +- 0.85 | 15.5 +- 0.53 | 15.8 +- 1.32 | 15.1 +- 0.74 | +1.94 +- 9.19 | -4.43 +- 9.23 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k-rnd | 15.3 +- 0.82 | 15.38 +- 0.52 | 15.4 +- 0.7 | 14.7 +- 0.48 | +0.16 +- 5.66 | -4.55 +- 5.35 | | 64b-2t1c-eth-l2xcbase | 17.7 +- 1.16 | 17.7 +- 0.67 | 17.5 +- 0.85 | 16.7 +- 0.95 | -1.13 +- 6.1 | -4.57 +- 7.13 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 47.3 +- 4.06 | 48.0 +- 4.14 | 48.9 +- 3.67 | 46.5 +- 6.1 | +1.88 +- 11.64 | -4.91 +- 14.36 | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 22.6 +- 3.37 | 21.6 +- 2.37 | 21.9 +- 1.37 | 20.8 +- 1.55 | +1.39 +- 12.79 | -5.02 +- 9.24 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 22.9 +- 2.28 | 23.5 +- 2.42 | 23.4 +- 1.96 | 22.2 +- 1.93 | -0.43 +- 13.19 | -5.13 +- 11.45 | | 78b-2t1c-ethip6-ip6scale20k | 20.0 +- 1.76 | 20.1 +- 0.88 | 20.5 +- 1.08 | 19.4 +- 0.84 | +1.99 +- 6.97 | -5.37 +- 6.46 | | 64b-2t1c-avf-eth-l2xcbase | 17.3 +- 1.25 | 17.7 +- 0.95 | 17.8 +- 1.23 | 16.8 +- 0.63 | +0.56 +- 8.79 | -5.62 +- 7.42 | | 64b-2t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 35.6 +- 1.26 | 35.6 +- 1.07 | 35.1 +- 1.29 | 32.8 +- 2.49 | -1.4 +- 4.68 | -6.55 +- 7.87 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 25.3 +- 2.67 | 25.2 +- 2.35 | 25.2 +- 1.14 | 23.5 +- 2.37 | +0.0 +- 10.35 | -6.75 +- 10.3 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 30.1 +- 2.88 | 31.1 +- 4.15 | 29.4 +- 3.81 | 27.4 +- 4.27 | -5.47 +- 17.57 | -6.8 +- 18.89 | | 78b-2t1c-avf-ethip6-ip6scale200k | 21.1 +- 2.23 | 21.2 +- 1.69 | 22.2 +- 3.08 | 20.6 +- 2.12 | +4.72 +- 16.76 | -7.21 +- 16.04 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 35.9 +- 2.85 | 37.2 +- 2.35 | 38.5 +- 2.37 | 35.7 +- 3.2 | +3.49 +- 9.12 | -7.27 +- 10.08 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 44.1 +- 4.38 | 43.0 +- 2.91 | 45.6 +- 2.88 | 42.0 +- 3.68 | +6.05 +- 9.8 | -7.89 +- 9.95 | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 21.9 +- 1.6 | 21.3 +- 1.95 | 23.0 +- 1.63 | 21.1 +- 1.6 | +7.98 +- 12.5 | -8.26 +- 9.51 | | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 20.9 +- 3.67 | 24.8 +- 2.49 | 24.3 +- 3.23 | 21.9 +- 3.14 | -2.02 +- 16.32 | -9.88 +- 17.64 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 34.4 +- 1.51 | 34.6 +- 1.65 | 34.8 +- 1.69 | 31.2 +- 1.14 | +0.58 +- 6.83 | -10.34 +- 5.43 | | 64b-2t1c-avf-ethip4-ip4base | 19.4 +- 1.07 | 18.8 +- 0.63 | 18.9 +- 0.32 | 16.9 +- 0.57 | +0.53 +- 3.78 | -10.58 +- 3.36 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 22.3 +- 1.25 | 22.3 +- 1.34 | 23.8 +- 2.74 | 21.2 +- 0.79 | +6.73 +- 13.86 | -10.92 +- 10.78 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 35.1 +- 1.1 | 35.6 +- 0.84 | 35.1 +- 0.74 | 31.0 +- 1.25 | -1.4 +- 3.12 | -11.68 +- 4.01 | | 64b-2t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 38.5 +- 1.18 | 39.6 +- 2.01 | 39.6 +- 2.07 | 34.8 +- 2.44 | +0.0 +- 7.28 | -12.12 +- 7.68 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 41.0 +- 1.33 | 42.1 +- 1.6 | 41.0 +- 1.63 | 35.7 +- 1.25 | -2.61 +- 5.35 | -12.93 +- 4.62 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 19.9 +- 0.74 | 20.6 +- 1.35 | 20.8 +- 1.32 | 18.1 +- 1.52 | +0.97 +- 9.2 | -12.98 +- 9.17 | | 64b-2t1c-eth-l2bdbasemaclrn | 20.3 +- 1.16 | 20.4 +- 1.35 | 21.5 +- 1.51 | 18.6 +- 1.71 | +5.39 +- 10.17 | -13.49 +- 10.02 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 21.2 +- 1.32 | 22.7 +- 2.0 | 22.7 +- 1.77 | 19.6 +- 0.97 | +0.0 +- 11.77 | -13.66 +- 7.96 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 39.8 +- 3.05 | 38.5 +- 2.17 | 38.0 +- 2.31 | 31.9 +- 1.66 | -1.3 +- 8.19 | -16.05 +- 6.72 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 38.7 +- 2.0 | 39.3 +- 1.49 | 40.3 +- 1.49 | 33.8 +- 2.3 | +2.54 +- 5.45 | -16.13 +- 6.5 | +--------------------------------------------------------------+--------------+---------------+--------------+--------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "8" for CSIT rls2110, "9" for CSIT rls2202). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2110.0-9 vs 2110.0-8: Compares CSIT environment current vs previous with previous VPP code. 2202.0-9 vs 2110.0-9: Compares VPP code current vs previous in the current CSIT environment.