+--------------------------------------------------------------+----------------+----------------+----------------+----------------+----------------------+----------------------+ | Test Case | 2106.0-8 | 2110.0-8 | 2110.0-9 | 2202.0-9 | 2110.0-9 vs 2110.0-8 | 2202.0-9 vs 2110.0-9 | +--------------------------------------------------------------+----------------+----------------+----------------+----------------+----------------------+----------------------+ | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 202.1 +- 48.85 | 151.8 +- 23.36 | 171.1 +- 33.22 | 252.7 +- 33.61 | +12.71 +- 27.93 | +47.69 +- 34.76 | | 64b-2t1c-avf-ethip4-ip4scale200k | 42.4 +- 2.59 | 45.5 +- 7.93 | 41.5 +- 1.51 | 48.2 +- 8.56 | -8.79 +- 16.25 | +16.14 +- 21.06 | | 78b-2t1c-avf-ethip6-ip6base | 36.1 +- 1.85 | 34.9 +- 2.18 | 33.6 +- 0.84 | 36.7 +- 0.82 | -3.72 +- 6.49 | +9.23 +- 3.68 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k | 17.2 +- 0.92 | 20.0 +- 3.46 | 17.6 +- 1.96 | 19.2 +- 4.13 | -12.0 +- 18.11 | +9.09 +- 26.42 | | 64b-2t1c-af-xdp-ethip4-ip4base | 19.8 +- 5.45 | 18.5 +- 1.51 | 19.3 +- 4.57 | 20.9 +- 7.06 | +4.32 +- 26.14 | +8.29 +- 44.69 | | 78b-2t1c-avf-ethip6-ip6scale2m | 38.8 +- 3.05 | 37.8 +- 2.78 | 37.7 +- 2.31 | 40.7 +- 2.83 | -0.26 +- 9.55 | +7.96 +- 10.01 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 99.4 +- 1.43 | 90.5 +- 4.33 | 91.2 +- 1.62 | 98.4 +- 2.01 | +0.77 +- 5.14 | +7.89 +- 2.92 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 41.3 +- 1.89 | 40.3 +- 2.58 | 41.1 +- 1.52 | 44.3 +- 3.8 | +1.99 +- 7.55 | +7.79 +- 10.08 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 39.7 +- 0.82 | 43.2 +- 2.66 | 41.9 +- 2.02 | 45.1 +- 0.88 | -3.01 +- 7.59 | +7.64 +- 5.61 | | 64b-2t1c-avf-ethip4-ip4scale20k | 44.0 +- 3.3 | 41.9 +- 2.47 | 41.0 +- 1.76 | 43.5 +- 1.51 | -2.15 +- 7.14 | +6.1 +- 5.86 | | 78b-2t1c-af-xdp-ethip6-ip6base | 17.7 +- 1.7 | 17.62 +- 2.07 | 18.1 +- 4.2 | 19.1 +- 4.2 | +2.7 +- 26.71 | +5.52 +- 33.75 | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 43.0 +- 2.26 | 41.1 +- 2.33 | 42.0 +- 2.45 | 44.3 +- 3.2 | +2.19 +- 8.31 | +5.48 +- 9.79 | | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 51.5 +- 1.08 | 43.9 +- 1.2 | 43.6 +- 1.35 | 45.7 +- 2.54 | -0.68 +- 4.1 | +4.82 +- 6.67 | | 64b-2t1c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir | 61.9 +- 0.99 | 80.6 +- 1.35 | 79.9 +- 1.2 | 82.5 +- 2.95 | -0.87 +- 2.23 | +3.25 +- 4.01 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 41.5 +- 1.78 | 37.5 +- 2.01 | 37.2 +- 1.75 | 38.0 +- 1.49 | -0.8 +- 7.08 | +2.15 +- 6.26 | | 64b-2t1c-avf-eth-l2xcbase | 27.7 +- 0.48 | 28.1 +- 0.57 | 28.3 +- 0.48 | 28.9 +- 0.32 | +0.71 +- 2.66 | +2.12 +- 2.07 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k-rnd | 18.5 +- 3.66 | 18.0 +- 2.67 | 17.6 +- 2.5 | 17.9 +- 3.03 | -2.22 +- 20.1 | +1.7 +- 22.51 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 46.5 +- 2.72 | 44.9 +- 1.2 | 45.6 +- 1.35 | 46.3 +- 1.16 | +1.56 +- 4.05 | +1.54 +- 3.94 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 46.7 +- 4.3 | 46.4 +- 4.14 | 46.4 +- 4.06 | 47.1 +- 4.72 | +0.0 +- 12.5 | +1.51 +- 13.51 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 37.2 +- 1.69 | 34.2 +- 0.63 | 35.0 +- 1.15 | 35.5 +- 1.58 | +2.34 +- 3.87 | +1.43 +- 5.62 | | 64b-2t1c-avf-ethip4-ip4base | 37.9 +- 1.2 | 36.4 +- 1.58 | 36.5 +- 0.97 | 36.9 +- 0.99 | +0.27 +- 5.1 | +1.1 +- 3.83 | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 37.5 +- 1.43 | 36.5 +- 1.43 | 37.4 +- 1.71 | 37.7 +- 1.83 | +2.47 +- 6.18 | +0.8 +- 6.72 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 37.7 +- 2.06 | 37.3 +- 1.77 | 36.9 +- 1.66 | 37.0 +- 2.16 | -1.07 +- 6.47 | +0.27 +- 7.4 | | 78b-2t1c-avf-ethip6-ip6scale200k | 41.1 +- 1.73 | 40.0 +- 2.49 | 40.3 +- 2.54 | 40.3 +- 2.41 | +0.75 +- 8.93 | +0.0 +- 8.68 | | 64b-2t1c-avf-eth-l2patch | 19.2 +- 0.63 | 19.0 +- 0.47 | 19.0 +- 0.0 | 18.9 +- 0.57 | +0.0 +- 2.48 | -0.53 +- 2.99 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 49.9 +- 1.66 | 45.2 +- 2.7 | 44.9 +- 1.97 | 44.5 +- 0.97 | -0.66 +- 7.36 | -0.89 +- 4.86 | | 64b-2t1c-avf-ethip4-ip4scale2m | 50.8 +- 8.09 | 61.2 +- 16.79 | 54.9 +- 17.58 | 54.1 +- 15.97 | -10.29 +- 37.83 | -1.46 +- 42.91 | | 78b-2t1c-avf-ethip6-ip6scale20k | 38.9 +- 4.7 | 36.7 +- 1.95 | 36.5 +- 2.37 | 35.9 +- 2.08 | -0.54 +- 8.34 | -1.64 +- 8.55 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 43.3 +- 1.57 | 44.4 +- 1.71 | 44.8 +- 1.14 | 43.9 +- 1.1 | +0.9 +- 4.66 | -2.01 +- 3.49 | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 37.0 +- 2.26 | 37.3 +- 1.06 | 38.2 +- 0.79 | 37.3 +- 0.82 | +2.41 +- 3.6 | -2.36 +- 2.95 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 39.1 +- 1.45 | 36.2 +- 2.39 | 36.8 +- 1.81 | 35.9 +- 0.57 | +1.66 +- 8.39 | -2.45 +- 5.05 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 170.7 +- 18.54 | 162.8 +- 16.05 | 165.3 +- 16.71 | 161.0 +- 26.21 | +1.54 +- 14.34 | -2.6 +- 18.67 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 125.4 +- 2.55 | 123.3 +- 2.5 | 122.9 +- 3.38 | 118.6 +- 1.84 | -0.32 +- 3.41 | -3.5 +- 3.05 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k-rnd | 17.9 +- 1.52 | 16.88 +- 1.73 | 20.2 +- 4.47 | 19.2 +- 3.77 | +19.7 +- 29.17 | -4.95 +- 28.09 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 38.5 +- 3.98 | 37.2 +- 4.05 | 40.6 +- 3.78 | 38.4 +- 2.63 | +9.14 +- 15.63 | -5.42 +- 10.93 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k | 17.8 +- 3.49 | 16.38 +- 1.69 | 18.8 +- 3.26 | 17.7 +- 3.43 | +14.81 +- 23.15 | -5.85 +- 24.49 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 48.2 +- 1.81 | 48.5 +- 1.18 | 49.3 +- 1.64 | 46.2 +- 1.23 | +1.65 +- 4.18 | -6.29 +- 3.99 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 43.8 +- 2.1 | 42.8 +- 1.4 | 42.6 +- 2.37 | 39.6 +- 1.51 | -0.47 +- 6.41 | -7.04 +- 6.26 | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 43.8 +- 1.48 | 43.5 +- 1.27 | 43.7 +- 2.31 | 39.4 +- 1.51 | +0.46 +- 6.07 | -9.84 +- 5.88 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 133.7 +- 3.33 | 128.0 +- 1.56 | 129.7 +- 2.75 | 110.8 +- 8.28 | +1.33 +- 2.48 | -14.57 +- 6.64 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 236.0 +- 85.04 | 126.4 +- 10.84 | 126.6 +- 11.94 | 107.6 +- 5.74 | +0.16 +- 12.77 | -15.01 +- 9.21 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 122.9 +- 5.49 | 119.9 +- 4.31 | 119.5 +- 3.75 | 96.7 +- 1.64 | -0.33 +- 4.75 | -19.08 +- 2.88 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 36.9 +- 3.35 | 36.6 +- 1.65 | 35.8 +- 1.4 | 28.9 +- 0.74 | -2.19 +- 5.83 | -19.27 +- 3.77 | | 78b-2t1c-ethip6-ip6scale20k | 34.9 +- 2.08 | 38.6 +- 3.57 | 39.5 +- 2.99 | 31.4 +- 0.84 | +2.33 +- 12.22 | -20.51 +- 6.39 | | 64b-2t1c-ethip4-ip4scale20k | 38.0 +- 2.16 | 36.9 +- 1.73 | 37.6 +- 2.41 | 29.1 +- 0.74 | +1.9 +- 8.1 | -22.61 +- 5.34 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 36.8 +- 0.63 | 40.4 +- 2.76 | 40.2 +- 3.01 | 31.1 +- 1.37 | -0.5 +- 10.08 | -22.64 +- 6.72 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 111.7 +- 2.36 | 112.2 +- 2.66 | 114.6 +- 1.84 | 88.3 +- 5.31 | +2.14 +- 2.92 | -22.95 +- 4.8 | | 78b-2t1c-ethip6-ip6base | 36.5 +- 1.78 | 38.2 +- 0.63 | 39.1 +- 1.97 | 29.4 +- 1.35 | +2.36 +- 5.43 | -24.81 +- 5.12 | | 64b-2t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 99.7 +- 1.89 | 102.5 +- 2.12 | 102.3 +- 2.5 | 76.6 +- 2.17 | -0.2 +- 3.19 | -25.12 +- 2.8 | | 64b-2t1c-ethip4-ip4base | 43.4 +- 4.14 | 36.8 +- 1.55 | 41.1 +- 5.86 | 30.4 +- 1.58 | +11.68 +- 16.6 | -26.03 +- 11.22 | | 64b-2t1c-eth-l2bdbasemaclrn | 41.0 +- 3.16 | 39.5 +- 2.84 | 38.2 +- 1.62 | 28.1 +- 1.1 | -3.29 +- 8.07 | -26.44 +- 4.25 | | 64b-2t1c-eth-l2patch | 28.5 +- 1.27 | 27.8 +- 0.92 | 28.1 +- 1.1 | 20.4 +- 0.7 | +1.08 +- 5.18 | -27.4 +- 3.78 | | 64b-2t1c-eth-l2bdscale1mmaclrn | 50.4 +- 3.06 | 49.5 +- 1.96 | 49.8 +- 1.62 | 34.3 +- 0.48 | +0.61 +- 5.15 | -31.12 +- 2.44 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 41.2 +- 2.7 | 44.0 +- 3.06 | 43.6 +- 4.72 | 29.9 +- 1.1 | -0.91 +- 12.74 | -31.42 +- 7.84 | | 64b-2t1c-eth-l2xcbase | 36.9 +- 2.38 | 35.9 +- 2.69 | 35.7 +- 2.16 | 23.4 +- 0.97 | -0.56 +- 9.57 | -34.45 +- 4.81 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 49.5 +- 4.2 | 50.3 +- 3.27 | 50.3 +- 4.0 | 31.2 +- 1.23 | +0.0 +- 10.27 | -37.97 +- 5.51 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 168.2 +- 6.55 | 150.7 +- 10.04 | 154.2 +- 3.91 | 90.8 +- 3.19 | +2.32 +- 7.3 | -41.12 +- 2.55 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 171.3 +- 18.84 | 173.5 +- 16.43 | 167.4 +- 19.16 | 93.5 +- 2.68 | -3.52 +- 14.33 | -44.15 +- 6.59 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 151.3 +- 4.83 | 147.2 +- 6.14 | 147.5 +- 3.1 | 82.2 +- 2.86 | +0.2 +- 4.68 | -44.27 +- 2.27 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 136.3 +- 3.8 | 136.7 +- 3.71 | 135.6 +- 6.35 | 66.6 +- 2.32 | -0.8 +- 5.37 | -50.88 +- 2.86 | | 64b-2t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 171.9 +- 32.19 | 181.6 +- 25.54 | 180.3 +- 26.85 | 84.9 +- 1.91 | -0.72 +- 20.34 | -52.91 +- 7.09 | +--------------------------------------------------------------+----------------+----------------+----------------+----------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "8" for CSIT rls2110, "9" for CSIT rls2202). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2110.0-9 vs 2110.0-8: Compares CSIT environment current vs previous with previous VPP code. 2202.0-9 vs 2110.0-9: Compares VPP code current vs previous in the current CSIT environment.