+--------------------------------------------------------------+----------------+-----------------+----------------+----------------+----------------------+----------------------+ | Test Case | 2101.0-7 | 2106.0-7 | 2106.0-8 | 2110.0-8 | 2106.0-8 vs 2106.0-7 | 2110.0-8 vs 2106.0-8 | +--------------------------------------------------------------+----------------+-----------------+----------------+----------------+----------------------+----------------------+ | 64b-2t1c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir | 60.8 +- 2.94 | 62.27 +- 1.79 | 61.9 +- 0.99 | 80.6 +- 1.35 | -0.6 +- 3.28 | +30.21 +- 3.02 | | 64b-2t1c-avf-ethip4-ip4scale2m | 28.5 +- 1.27 | 47.36 +- 8.41 | 50.8 +- 8.09 | 61.2 +- 16.79 | +7.26 +- 25.58 | +20.47 +- 38.22 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k | NT | 69.8 +- 26.29 | 17.2 +- 0.92 | 20.0 +- 3.46 | -75.36 +- 9.37 | +16.28 +- 21.08 | | 78b-2t1c-ethip6-ip6scale20k | 29.5 +- 1.78 | 35.73 +- 2.83 | 34.9 +- 2.08 | 38.6 +- 3.57 | -2.32 +- 9.69 | +10.6 +- 12.16 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 29.7 +- 0.67 | 37.64 +- 2.46 | 36.8 +- 0.63 | 40.4 +- 2.76 | -2.22 +- 6.61 | +9.78 +- 7.73 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 36.4 +- 2.17 | 40.27 +- 1.1 | 39.7 +- 0.82 | 43.2 +- 2.66 | -1.42 +- 3.39 | +8.82 +- 7.07 | | 64b-2t1c-avf-ethip4-ip4scale200k | 28.1 +- 2.13 | 48.82 +- 5.81 | 42.4 +- 2.59 | 45.5 +- 7.93 | -13.15 +- 11.62 | +7.31 +- 19.83 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 31.8 +- 1.62 | 40.09 +- 1.45 | 41.2 +- 2.7 | 44.0 +- 3.06 | +2.77 +- 7.69 | +6.8 +- 10.2 | | 64b-2t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 92.9 +- 3.63 | 182.45 +- 29.09 | 171.9 +- 32.19 | 181.6 +- 25.54 | -5.78 +- 23.17 | +5.64 +- 24.74 | | 78b-2t1c-ethip6-ip6base | 27.0 +- 1.25 | 35.82 +- 1.72 | 36.5 +- 1.78 | 38.2 +- 0.63 | +1.9 +- 6.98 | +4.66 +- 5.39 | | 64b-2t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 63.5 +- 4.5 | 100.55 +- 2.07 | 99.7 +- 1.89 | 102.5 +- 2.12 | -0.84 +- 2.77 | +2.81 +- 2.88 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 38.5 +- 1.65 | 42.82 +- 2.04 | 43.3 +- 1.57 | 44.4 +- 1.71 | +1.13 +- 6.05 | +2.54 +- 5.42 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 34.6 +- 1.51 | 49.18 +- 3.97 | 49.5 +- 4.2 | 50.3 +- 3.27 | +0.65 +- 11.78 | +1.62 +- 10.85 | | 78b-2t1c-ethip6-ip6scale2m | 32.4 +- 2.41 | 38.91 +- 1.7 | 38.9 +- 1.6 | 39.5 +- 2.27 | -0.02 +- 5.99 | +1.54 +- 7.18 | | 64b-2t1c-avf-eth-l2xcbase | 21.9 +- 0.32 | 28.27 +- 0.9 | 27.7 +- 0.48 | 28.1 +- 0.57 | -2.03 +- 3.57 | +1.44 +- 2.71 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 104.7 +- 10.35 | 174.45 +- 21.84 | 171.3 +- 18.84 | 173.5 +- 16.43 | -1.81 +- 16.36 | +1.28 +- 14.7 | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 27.2 +- 1.32 | 37.45 +- 0.52 | 37.0 +- 2.26 | 37.3 +- 1.06 | -1.21 +- 6.19 | +0.81 +- 6.79 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 41.8 +- 0.92 | 49.27 +- 1.01 | 48.2 +- 1.81 | 48.5 +- 1.18 | -2.18 +- 4.19 | +0.62 +- 4.51 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 75.7 +- 2.91 | 110.91 +- 1.81 | 111.7 +- 2.36 | 112.2 +- 2.66 | +0.71 +- 2.69 | +0.45 +- 3.19 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 96.1 +- 3.54 | 134.82 +- 3.54 | 136.3 +- 3.8 | 136.7 +- 3.71 | +1.1 +- 3.88 | +0.29 +- 3.91 | | 78b-2t1c-af-xdp-ethip6-ip6base | NT | 62.4 +- 12.39 | 17.7 +- 1.7 | 17.62 +- 2.07 | -71.63 +- 6.26 | -0.42 +- 15.1 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 41.6 +- 8.14 | 45.45 +- 6.71 | 46.7 +- 4.3 | 46.4 +- 4.14 | +2.74 +- 17.88 | -0.64 +- 12.74 | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 35.4 +- 2.12 | 43.91 +- 2.88 | 43.8 +- 1.48 | 43.5 +- 1.27 | -0.25 +- 7.35 | -0.68 +- 4.43 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 31.0 +- 2.05 | 36.0 +- 3.03 | 36.9 +- 3.35 | 36.6 +- 1.65 | +2.5 +- 12.69 | -0.81 +- 10.05 | | 64b-2t1c-ethip4-ip4scale2m | 31.2 +- 3.29 | 44.45 +- 5.65 | 45.4 +- 5.17 | 45.0 +- 5.08 | +2.13 +- 17.42 | -0.88 +- 15.89 | | 64b-2t1c-ethip4-ip4scale2m-rnd | 30.7 +- 2.21 | 38.45 +- 1.37 | 38.9 +- 1.66 | 38.5 +- 1.18 | +1.16 +- 5.63 | -1.03 +- 5.2 | | 64b-2t1c-avf-eth-l2patch | 16.6 +- 0.7 | 17.91 +- 1.3 | 19.2 +- 0.63 | 19.0 +- 0.47 | +7.21 +- 8.55 | -1.04 +- 4.08 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 42.3 +- 3.59 | 37.45 +- 2.5 | 37.7 +- 2.06 | 37.3 +- 1.77 | +0.66 +- 8.69 | -1.06 +- 7.15 | | 64b-2t1c-ethip4-ip4scale200k | 30.0 +- 1.25 | 38.45 +- 1.63 | 38.7 +- 1.77 | 38.2 +- 1.87 | +0.64 +- 6.28 | -1.29 +- 6.61 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 86.9 +- 2.88 | 127.09 +- 2.51 | 125.4 +- 2.55 | 123.3 +- 2.5 | -1.33 +- 2.79 | -1.67 +- 2.82 | | 78b-2t1c-ethip6-ip6scale200k | 31.1 +- 2.56 | 40.82 +- 2.04 | 40.0 +- 2.31 | 39.3 +- 2.06 | -2.0 +- 7.48 | -1.75 +- 7.66 | | 64b-2t1c-eth-l2bdscale1mmaclrn | 37.4 +- 2.67 | 50.64 +- 2.69 | 50.4 +- 3.06 | 49.5 +- 1.96 | -0.47 +- 8.04 | -1.79 +- 7.12 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 31.5 +- 0.71 | 42.27 +- 1.68 | 43.8 +- 2.1 | 42.8 +- 1.4 | +3.61 +- 6.45 | -2.28 +- 5.67 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 27.5 +- 1.78 | 41.91 +- 2.66 | 41.3 +- 1.89 | 40.3 +- 2.58 | -1.45 +- 7.71 | -2.42 +- 7.69 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 66.3 +- 1.64 | 118.64 +- 4.82 | 122.9 +- 5.49 | 119.9 +- 4.31 | +3.59 +- 6.25 | -2.44 +- 5.59 | | 64b-2t1c-eth-l2patch | 24.7 +- 1.06 | 28.36 +- 1.12 | 28.5 +- 1.27 | 27.8 +- 0.92 | +0.48 +- 5.98 | -2.46 +- 5.41 | | 78b-2t1c-avf-ethip6-ip6scale2m | 31.2 +- 1.99 | 39.64 +- 3.8 | 38.8 +- 3.05 | 37.8 +- 2.78 | -2.11 +- 12.14 | -2.58 +- 10.48 | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 27.7 +- 1.57 | 37.27 +- 1.85 | 37.5 +- 1.43 | 36.5 +- 1.43 | +0.61 +- 6.3 | -2.67 +- 5.34 | | 78b-2t1c-avf-ethip6-ip6scale200k | 29.4 +- 0.97 | 41.45 +- 2.54 | 41.1 +- 1.73 | 40.0 +- 2.49 | -0.86 +- 7.38 | -2.68 +- 7.32 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k-rnd | NT | 85.44 +- 72.93 | 18.5 +- 3.66 | 18.0 +- 2.67 | -78.35 +- 18.97 | -2.7 +- 24.06 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 80.8 +- 2.25 | 150.27 +- 2.76 | 151.3 +- 4.83 | 147.2 +- 6.14 | +0.68 +- 3.71 | -2.71 +- 5.11 | | 64b-2t1c-eth-l2xcbase | 26.4 +- 1.07 | 35.18 +- 2.04 | 36.9 +- 2.38 | 35.9 +- 2.69 | +4.88 +- 9.09 | -2.71 +- 9.61 | | 64b-2t1c-ethip4-ip4scale20k | 29.9 +- 0.99 | 36.73 +- 2.15 | 38.0 +- 2.16 | 36.9 +- 1.73 | +3.47 +- 8.44 | -2.89 +- 7.15 | | 78b-2t1c-ethip6-ip6scale200k-rnd | 30.9 +- 3.78 | 43.09 +- 3.45 | 43.5 +- 2.95 | 42.2 +- 1.14 | +0.95 +- 10.59 | -2.99 +- 7.08 | | 78b-2t1c-avf-ethip6-ip6base | 26.9 +- 0.74 | 35.09 +- 1.14 | 36.1 +- 1.85 | 34.9 +- 2.18 | +2.88 +- 6.24 | -3.32 +- 7.82 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 40.1 +- 2.51 | 40.45 +- 4.01 | 38.5 +- 3.98 | 37.2 +- 4.05 | -4.83 +- 13.63 | -3.38 +- 14.5 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 34.2 +- 2.62 | 46.64 +- 1.12 | 46.5 +- 2.72 | 44.9 +- 1.2 | -0.29 +- 6.3 | -3.44 +- 6.2 | | 64b-2t1c-ethip4-ip4scale200k-rnd | 29.9 +- 2.23 | 45.09 +- 3.51 | 43.5 +- 1.9 | 42.0 +- 1.76 | -3.53 +- 8.6 | -3.45 +- 5.85 | | 64b-2t1c-eth-l2bdbasemaclrn | 32.1 +- 1.29 | 43.09 +- 2.59 | 41.0 +- 3.16 | 39.5 +- 2.84 | -4.85 +- 9.3 | -3.66 +- 10.16 | | 64b-2t1c-avf-ethip4-ip4base | 28.5 +- 1.43 | 38.09 +- 1.51 | 37.9 +- 1.2 | 36.4 +- 1.58 | -0.5 +- 5.05 | -3.96 +- 5.15 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 74.3 +- 1.89 | 134.27 +- 3.1 | 133.7 +- 3.33 | 128.0 +- 1.56 | -0.43 +- 3.39 | -4.26 +- 2.66 | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 29.6 +- 1.26 | 42.64 +- 1.12 | 43.0 +- 2.26 | 41.1 +- 2.33 | +0.85 +- 5.93 | -4.42 +- 7.39 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 99.6 +- 11.56 | 194.0 +- 52.54 | 170.7 +- 18.54 | 162.8 +- 16.05 | -12.01 +- 25.68 | -4.63 +- 13.99 | | 64b-2t1c-avf-ethip4-ip4scale20k | 27.9 +- 1.52 | 43.09 +- 2.07 | 44.0 +- 3.3 | 41.9 +- 2.47 | +2.11 +- 9.1 | -4.77 +- 9.08 | | 78b-2t1c-avf-ethip6-ip6scale20k | 28.5 +- 1.51 | 38.82 +- 1.54 | 38.9 +- 4.7 | 36.7 +- 1.95 | +0.21 +- 12.74 | -5.66 +- 12.45 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k-rnd | NT | 102.0 +- 72.0 | 17.9 +- 1.52 | 16.88 +- 1.73 | -82.45 +- 12.48 | -5.73 +- 12.55 | | 64b-2t1c-af-xdp-ethip4-ip4base | NT | 58.78 +- 15.65 | 19.8 +- 5.45 | 18.5 +- 1.51 | -66.31 +- 12.9 | -6.57 +- 26.84 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 29.2 +- 1.48 | 40.73 +- 1.42 | 39.1 +- 1.45 | 36.2 +- 2.39 | -4.0 +- 4.89 | -7.42 +- 7.02 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k | NT | 64.67 +- 19.81 | 17.8 +- 3.49 | 16.38 +- 1.69 | -72.47 +- 10.01 | -8.01 +- 20.37 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 26.0 +- 1.56 | 36.36 +- 1.5 | 37.2 +- 1.69 | 34.2 +- 0.63 | +2.3 +- 6.27 | -8.06 +- 4.5 | | 78b-2t1c-ethip6-ip6scale2m-rnd | 34.8 +- 1.23 | 45.55 +- 3.8 | 44.9 +- 4.51 | 41.1 +- 2.38 | -1.42 +- 12.88 | -8.46 +- 10.61 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 70.1 +- 2.64 | 98.0 +- 1.26 | 99.4 +- 1.43 | 90.5 +- 4.33 | +1.43 +- 1.96 | -8.95 +- 4.55 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 40.2 +- 1.69 | 51.0 +- 0.89 | 49.9 +- 1.66 | 45.2 +- 2.7 | -2.16 +- 3.69 | -9.42 +- 6.2 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 27.1 +- 0.32 | 40.45 +- 1.75 | 41.5 +- 1.78 | 37.5 +- 2.01 | +2.58 +- 6.25 | -9.64 +- 6.21 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 106.7 +- 14.97 | 169.45 +- 6.33 | 168.2 +- 6.55 | 150.7 +- 10.04 | -0.74 +- 5.35 | -10.4 +- 6.92 | | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 33.2 +- 0.92 | 49.45 +- 2.5 | 51.5 +- 1.08 | 43.9 +- 1.2 | +4.14 +- 5.71 | -14.76 +- 2.93 | | 64b-2t1c-ethip4-ip4base | 31.2 +- 1.55 | 42.18 +- 4.77 | 43.4 +- 4.14 | 36.8 +- 1.55 | +2.89 +- 15.23 | -15.21 +- 8.84 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 100.3 +- 6.17 | 202.0 +- 45.81 | 202.1 +- 48.85 | 151.8 +- 23.36 | +0.05 +- 33.16 | -24.89 +- 21.52 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 77.0 +- 6.04 | 139.45 +- 34.12 | 236.0 +- 85.04 | 126.4 +- 10.84 | +69.23 +- 73.71 | -46.44 +- 19.84 | +--------------------------------------------------------------+----------------+-----------------+----------------+----------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "7" for CSIT rls2106, "8" for CSIT rls2110). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2106.0-8 vs 2106.0-7: Compares CSIT environment current vs previous with previous VPP code. 2110.0-8 vs 2106.0-8: Compares VPP code current vs previous in the current CSIT environment.