+--------------------------------------------------------------+----------------+----------------+----------------+----------------+----------------------+----------------------+ | Test Case | 2106.0-8 | 2110.0-8 | 2110.0-9 | 2202.0-9 | 2110.0-9 vs 2110.0-8 | 2202.0-9 vs 2110.0-9 | +--------------------------------------------------------------+----------------+----------------+----------------+----------------+----------------------+----------------------+ | 78b-2t1c-af-xdp-ethip6-ip6base | 20.5 +- 5.58 | 19.5 +- 2.84 | 17.7 +- 2.79 | 24.3 +- 21.72 | -9.23 +- 19.48 | +37.29 +- 124.61 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 123.8 +- 7.97 | 105.5 +- 1.96 | 105.8 +- 2.57 | 136.8 +- 4.26 | +0.28 +- 3.07 | +29.3 +- 5.11 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 264.4 +- 67.02 | 214.7 +- 36.01 | 245.4 +- 37.62 | 295.5 +- 39.97 | +14.3 +- 25.97 | +20.42 +- 24.62 | | 64b-2t1c-avf-eth-l2xcbase | 31.3 +- 0.48 | 32.0 +- 0.47 | 31.2 +- 2.53 | 34.1 +- 1.2 | -2.5 +- 8.04 | +9.29 +- 9.66 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k-rnd | 17.3 +- 1.95 | 17.3 +- 2.41 | 18.6 +- 4.65 | 20.3 +- 4.3 | +7.51 +- 30.75 | +9.14 +- 35.74 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 97.6 +- 4.58 | 89.4 +- 3.2 | 89.2 +- 1.69 | 96.3 +- 3.74 | -0.22 +- 4.04 | +7.96 +- 4.67 | | 78b-2t1c-avf-ethip6-ip6base | 38.6 +- 1.17 | 37.8 +- 1.23 | 38.2 +- 1.62 | 40.1 +- 1.2 | +1.06 +- 5.4 | +4.97 +- 5.44 | | 64b-2t1c-avf-ethip4-ip4scale2m | 49.9 +- 12.63 | 47.2 +- 5.31 | 53.1 +- 12.08 | 55.6 +- 14.46 | +12.5 +- 28.55 | +4.71 +- 36.18 | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 46.2 +- 1.14 | 44.2 +- 1.75 | 42.8 +- 1.48 | 44.4 +- 1.35 | -3.17 +- 5.09 | +3.74 +- 4.77 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 49.5 +- 1.27 | 47.5 +- 0.97 | 48.1 +- 1.1 | 49.4 +- 1.84 | +1.26 +- 3.11 | +2.7 +- 4.49 | | 64b-2t1c-af-xdp-ethip4-ip4base | 18.2 +- 2.66 | 18.1 +- 2.13 | 18.8 +- 3.61 | 19.3 +- 3.4 | +3.87 +- 23.42 | +2.66 +- 26.77 | | 64b-2t1c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir | 66.6 +- 1.35 | 85.0 +- 1.15 | 83.9 +- 1.2 | 85.7 +- 0.67 | -1.29 +- 1.94 | +2.15 +- 1.66 | | 78b-2t1c-avf-ethip6-ip6scale200k | 41.5 +- 2.37 | 40.2 +- 1.32 | 39.9 +- 1.79 | 40.6 +- 1.71 | -0.75 +- 5.52 | +1.75 +- 6.27 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 37.4 +- 0.52 | 37.2 +- 1.32 | 37.6 +- 1.78 | 38.1 +- 1.29 | +1.08 +- 5.97 | +1.33 +- 5.88 | | 64b-2t1c-avf-ethip4-ip4base | 39.1 +- 0.88 | 38.3 +- 1.16 | 38.6 +- 0.97 | 39.1 +- 0.88 | +0.78 +- 3.96 | +1.3 +- 3.4 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 50.5 +- 6.55 | 49.4 +- 2.84 | 49.8 +- 4.1 | 50.0 +- 4.37 | +0.81 +- 10.13 | +0.4 +- 12.06 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 40.9 +- 1.29 | 39.4 +- 1.43 | 39.5 +- 0.97 | 39.6 +- 1.26 | +0.25 +- 4.4 | +0.25 +- 4.04 | | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 55.6 +- 2.32 | 47.4 +- 1.07 | 47.7 +- 1.34 | 47.5 +- 1.72 | +0.63 +- 3.63 | -0.42 +- 4.55 | | 78b-2t1c-avf-ethip6-ip6scale2m | 41.9 +- 2.08 | 40.2 +- 3.33 | 41.0 +- 3.92 | 40.8 +- 4.49 | +1.99 +- 12.89 | -0.49 +- 14.5 | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 40.1 +- 0.99 | 40.0 +- 1.56 | 39.4 +- 1.65 | 39.2 +- 2.2 | -1.5 +- 5.64 | -0.51 +- 6.96 | | 78b-2t1c-avf-ethip6-ip6scale20k | 39.3 +- 1.25 | 38.8 +- 1.03 | 38.6 +- 1.17 | 38.4 +- 1.17 | -0.52 +- 4.02 | -0.52 +- 4.29 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 42.7 +- 3.59 | 40.0 +- 1.49 | 40.2 +- 1.14 | 39.9 +- 2.56 | +0.5 +- 4.7 | -0.75 +- 6.95 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 48.0 +- 0.82 | 48.5 +- 1.84 | 48.9 +- 1.2 | 48.4 +- 1.26 | +0.82 +- 4.55 | -1.02 +- 3.54 | | 64b-2t1c-avf-ethip4-ip4scale20k | 43.8 +- 2.2 | 44.1 +- 3.38 | 43.8 +- 2.25 | 43.2 +- 2.53 | -0.68 +- 9.17 | -1.37 +- 7.68 | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 39.9 +- 1.1 | 39.6 +- 1.26 | 39.4 +- 1.26 | 38.8 +- 0.63 | -0.51 +- 4.51 | -1.52 +- 3.55 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 43.2 +- 2.3 | 38.7 +- 1.34 | 38.7 +- 1.57 | 37.9 +- 0.88 | +0.0 +- 5.32 | -2.07 +- 4.57 | | 64b-2t1c-avf-eth-l2patch | 18.7 +- 0.95 | 18.4 +- 0.7 | 18.4 +- 1.07 | 17.9 +- 0.32 | +0.0 +- 6.97 | -2.72 +- 5.94 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 51.3 +- 0.67 | 52.9 +- 1.1 | 52.2 +- 1.23 | 50.3 +- 0.82 | -1.32 +- 3.1 | -3.64 +- 2.76 | | 64b-2t1c-avf-ethip4-ip4scale200k | 45.0 +- 2.49 | 45.5 +- 2.42 | 46.9 +- 7.74 | 44.8 +- 2.15 | +3.08 +- 17.87 | -4.48 +- 16.41 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 50.7 +- 0.95 | 50.2 +- 1.32 | 50.2 +- 0.92 | 47.8 +- 1.03 | +0.0 +- 3.2 | -4.78 +- 2.7 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 50.9 +- 0.88 | 48.8 +- 0.92 | 48.8 +- 1.03 | 46.2 +- 0.92 | +0.0 +- 2.83 | -5.33 +- 2.75 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 44.1 +- 1.2 | 44.2 +- 1.93 | 43.6 +- 1.43 | 40.8 +- 1.62 | -1.36 +- 5.39 | -6.42 +- 4.82 | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 46.1 +- 1.29 | 45.0 +- 1.05 | 45.5 +- 1.08 | 42.0 +- 1.33 | +1.11 +- 3.37 | -7.69 +- 3.66 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k | 17.2 +- 1.4 | 17.3 +- 2.21 | 20.1 +- 3.14 | 18.5 +- 4.03 | +16.18 +- 23.47 | -7.96 +- 24.7 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 159.7 +- 4.08 | 159.3 +- 3.74 | 158.2 +- 1.99 | 145.4 +- 3.24 | -0.69 +- 2.65 | -8.09 +- 2.35 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 238.1 +- 58.08 | 190.5 +- 20.72 | 200.3 +- 17.99 | 183.6 +- 14.55 | +5.14 +- 14.83 | -8.34 +- 10.98 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k-rnd | 17.8 +- 2.35 | 17.6 +- 1.71 | 18.6 +- 2.88 | 17.0 +- 1.63 | +5.68 +- 19.3 | -8.6 +- 16.63 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 169.9 +- 24.93 | 146.7 +- 17.37 | 136.9 +- 6.08 | 124.9 +- 5.28 | -6.68 +- 11.8 | -8.77 +- 5.59 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k | 16.6 +- 0.97 | 20.0 +- 5.77 | 18.0 +- 4.55 | 16.4 +- 0.97 | -10.0 +- 34.52 | -8.89 +- 23.63 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 157.1 +- 3.03 | 155.4 +- 2.91 | 154.9 +- 2.73 | 136.4 +- 2.41 | -0.32 +- 2.56 | -11.94 +- 2.2 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 43.6 +- 2.27 | 44.6 +- 1.71 | 47.5 +- 6.26 | 40.0 +- 3.13 | +6.5 +- 14.62 | -15.79 +- 12.9 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 54.9 +- 14.76 | 47.5 +- 4.72 | 47.0 +- 5.72 | 38.8 +- 2.66 | -1.05 +- 15.54 | -17.45 +- 11.52 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 121.2 +- 3.01 | 121.6 +- 3.63 | 122.5 +- 1.96 | 100.2 +- 1.4 | +0.74 +- 3.41 | -18.2 +- 1.74 | | 78b-2t1c-ethip6-ip6scale20k | 39.5 +- 2.32 | 40.6 +- 1.58 | 41.2 +- 3.19 | 32.9 +- 0.57 | +1.48 +- 8.79 | -20.15 +- 6.34 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 39.9 +- 2.18 | 39.4 +- 2.46 | 38.8 +- 1.81 | 30.3 +- 1.42 | -1.52 +- 7.68 | -21.91 +- 5.17 | | 64b-2t1c-ethip4-ip4scale20k | 39.2 +- 1.48 | 38.3 +- 1.57 | 39.3 +- 1.7 | 30.0 +- 0.67 | +2.61 +- 6.12 | -23.66 +- 3.72 | | 78b-2t1c-ethip6-ip6base | 38.8 +- 1.14 | 41.3 +- 2.0 | 41.1 +- 2.18 | 31.0 +- 1.15 | -0.48 +- 7.16 | -24.57 +- 4.89 | | 64b-2t1c-eth-l2patch | 29.2 +- 0.92 | 28.6 +- 1.26 | 29.3 +- 0.67 | 21.2 +- 1.87 | +2.45 +- 5.11 | -27.65 +- 6.61 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 41.6 +- 2.99 | 46.3 +- 1.06 | 44.8 +- 2.2 | 32.3 +- 1.06 | -3.24 +- 5.24 | -27.9 +- 4.26 | | 64b-2t1c-eth-l2bdbasemaclrn | 45.8 +- 4.71 | 42.7 +- 3.09 | 41.2 +- 2.7 | 29.4 +- 1.07 | -3.51 +- 9.42 | -28.64 +- 5.35 | | 64b-2t1c-ethip4-ip4base | 43.1 +- 4.84 | 41.8 +- 5.57 | 43.4 +- 3.95 | 29.5 +- 0.53 | +3.83 +- 16.76 | -32.03 +- 6.3 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 50.8 +- 1.55 | 53.9 +- 3.51 | 52.4 +- 3.1 | 33.4 +- 0.7 | -2.78 +- 8.55 | -36.26 +- 4.0 | | 64b-2t1c-eth-l2xcbase | 37.8 +- 2.53 | 39.0 +- 1.49 | 38.3 +- 1.06 | 24.1 +- 0.99 | -1.79 +- 4.63 | -37.08 +- 3.13 | | 64b-2t1c-eth-l2bdscale1mmaclrn | 56.7 +- 1.64 | 55.7 +- 2.54 | 57.0 +- 3.65 | 35.3 +- 2.54 | +2.33 +- 8.05 | -38.07 +- 5.97 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 181.3 +- 5.1 | 179.9 +- 3.07 | 180.3 +- 2.58 | 98.3 +- 1.34 | +0.22 +- 2.23 | -45.48 +- 1.08 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 210.9 +- 28.82 | 228.0 +- 18.23 | 199.4 +- 20.27 | 104.0 +- 3.8 | -12.54 +- 11.31 | -47.84 +- 5.63 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 51.6 +- 7.04 | 59.3 +- 4.55 | 60.5 +- 7.01 | 30.4 +- 2.37 | +2.02 +- 14.18 | -49.75 +- 7.02 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 181.0 +- 9.99 | 181.1 +- 7.09 | 182.2 +- 4.69 | 88.4 +- 1.43 | +0.61 +- 4.71 | -51.48 +- 1.47 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 156.1 +- 4.75 | 154.7 +- 5.79 | 150.9 +- 5.43 | 70.1 +- 0.88 | -2.46 +- 5.06 | -53.55 +- 1.77 | +--------------------------------------------------------------+----------------+----------------+----------------+----------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "8" for CSIT rls2110, "9" for CSIT rls2202). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2110.0-9 vs 2110.0-8: Compares CSIT environment current vs previous with previous VPP code. 2202.0-9 vs 2110.0-9: Compares VPP code current vs previous in the current CSIT environment.