+--------------------------------------------------------------+----------------+----------------+----------------+----------------+----------------------+----------------------+ | Test Case | 2106.0-8 | 2110.0-8 | 2110.0-9 | 2202.0-9 | 2110.0-9 vs 2110.0-8 | 2202.0-9 vs 2110.0-9 | +--------------------------------------------------------------+----------------+----------------+----------------+----------------+----------------------+----------------------+ | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 186.0 +- 5.96 | 179.0 +- 3.56 | 177.4 +- 3.34 | 181.9 +- 9.85 | -0.89 +- 2.71 | +2.54 +- 5.88 | | 64b-2t1c-avf-ethip4-ip4base | 44.1 +- 4.79 | 42.5 +- 1.58 | 42.6 +- 1.17 | 43.2 +- 1.23 | +0.24 +- 4.64 | +1.41 +- 4.02 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 130.3 +- 8.29 | 123.5 +- 4.12 | 119.0 +- 2.36 | 118.0 +- 3.4 | -3.64 +- 3.74 | -0.84 +- 3.47 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 47.8 +- 0.79 | 45.2 +- 1.75 | 45.9 +- 2.18 | 45.2 +- 3.33 | +1.55 +- 6.23 | -1.53 +- 8.63 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 43.8 +- 1.32 | 43.5 +- 0.85 | 43.4 +- 0.52 | 42.7 +- 1.06 | -0.23 +- 2.28 | -1.61 +- 2.71 | | 64b-2t1c-avf-ethip4-ip4scale20k | 47.7 +- 1.57 | 48.0 +- 1.33 | 47.7 +- 1.77 | 46.8 +- 1.55 | -0.62 +- 4.6 | -1.89 +- 4.87 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 209.6 +- 14.1 | 194.5 +- 3.81 | 194.3 +- 2.45 | 190.5 +- 5.78 | -0.1 +- 2.33 | -1.96 +- 3.22 | | 64b-2t1c-avf-eth-l2xcbase | 41.5 +- 1.27 | 39.8 +- 2.57 | 40.7 +- 1.06 | 39.7 +- 1.06 | +2.26 +- 7.13 | -2.46 +- 3.64 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 47.0 +- 6.58 | 45.6 +- 4.97 | 46.4 +- 1.65 | 45.0 +- 0.94 | +1.75 +- 11.67 | -3.02 +- 4.0 | | 64b-2t1c-avf-eth-l2patch | 22.7 +- 0.67 | 22.4 +- 0.7 | 23.0 +- 0.0 | 22.2 +- 1.23 | +2.68 +- 3.21 | -3.48 +- 5.34 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 54.2 +- 2.15 | 58.5 +- 1.51 | 58.6 +- 1.58 | 56.5 +- 1.58 | +0.17 +- 3.74 | -3.58 +- 3.74 | | 64b-2t1c-avf-ethip4udp-nat44det-h262144-p63-s16515072 | 66.0 +- 5.54 | 58.0 +- 3.02 | 57.9 +- 2.88 | 55.8 +- 2.62 | -0.17 +- 7.19 | -3.63 +- 6.59 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 232.1 +- 7.32 | 226.4 +- 12.95 | 222.7 +- 12.82 | 214.3 +- 15.87 | -1.63 +- 7.98 | -3.77 +- 9.03 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 104.7 +- 6.72 | 96.6 +- 5.6 | 100.8 +- 7.24 | 96.1 +- 4.89 | +4.35 +- 9.63 | -4.66 +- 8.39 | | 78b-2t1c-avf-ethip6-ip6base | 43.8 +- 1.4 | 45.3 +- 1.64 | 44.7 +- 0.95 | 42.3 +- 1.77 | -1.32 +- 4.13 | -5.37 +- 4.43 | | 78b-2t1c-avf-ethip6-ip6scale20k | 49.3 +- 2.58 | 47.0 +- 0.82 | 48.4 +- 1.07 | 45.8 +- 5.12 | +2.98 +- 2.9 | -5.37 +- 10.78 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 52.2 +- 1.93 | 52.0 +- 1.41 | 51.7 +- 1.16 | 48.9 +- 1.2 | -0.58 +- 3.5 | -5.42 +- 3.14 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 60.5 +- 4.99 | 65.1 +- 2.85 | 63.1 +- 3.48 | 59.1 +- 3.28 | -3.07 +- 6.82 | -6.34 +- 7.33 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 53.2 +- 2.04 | 55.0 +- 1.05 | 54.6 +- 1.78 | 51.1 +- 0.88 | -0.73 +- 3.75 | -6.41 +- 3.44 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 57.7 +- 2.11 | 57.7 +- 1.89 | 58.2 +- 1.4 | 54.1 +- 1.73 | +0.87 +- 4.1 | -7.04 +- 3.72 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 50.1 +- 0.57 | 49.9 +- 0.74 | 49.5 +- 0.85 | 45.9 +- 0.57 | -0.8 +- 2.25 | -7.27 +- 1.96 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 111.4 +- 3.44 | 108.3 +- 3.33 | 109.3 +- 3.62 | 99.3 +- 3.92 | +0.92 +- 4.57 | -9.15 +- 4.68 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 43.3 +- 1.83 | 44.8 +- 1.14 | 45.1 +- 2.13 | 40.9 +- 1.1 | +0.67 +- 5.4 | -9.31 +- 4.93 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 159.1 +- 4.07 | 160.9 +- 6.14 | 159.2 +- 5.35 | 143.5 +- 3.31 | -1.06 +- 5.03 | -9.86 +- 3.67 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 55.2 +- 2.49 | 56.6 +- 1.96 | 56.2 +- 3.08 | 50.0 +- 1.56 | -0.71 +- 6.44 | -11.03 +- 5.62 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 58.7 +- 3.83 | 63.1 +- 1.45 | 61.7 +- 2.87 | 54.2 +- 1.03 | -2.22 +- 5.07 | -12.16 +- 4.41 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 56.3 +- 2.16 | 64.3 +- 8.64 | 65.2 +- 9.25 | 55.5 +- 5.85 | +1.4 +- 19.81 | -14.88 +- 15.05 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 177.6 +- 4.79 | 176.8 +- 4.18 | 176.2 +- 1.99 | 141.9 +- 6.06 | -0.34 +- 2.61 | -19.47 +- 3.56 | | 78b-2t1c-ethip6-ip6scale20k | 57.0 +- 3.65 | 61.7 +- 1.49 | 59.0 +- 0.94 | 47.5 +- 0.97 | -4.38 +- 2.77 | -19.49 +- 2.09 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 215.0 +- 10.11 | 178.2 +- 3.52 | 176.9 +- 3.41 | 140.9 +- 4.77 | -0.73 +- 2.74 | -20.35 +- 3.1 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 344.5 +- 33.16 | 367.9 +- 46.59 | 305.0 +- 21.82 | 236.6 +- 16.59 | -17.1 +- 12.06 | -22.43 +- 7.77 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 177.2 +- 3.97 | 177.1 +- 1.66 | 176.8 +- 2.82 | 136.3 +- 2.06 | -0.17 +- 1.85 | -22.91 +- 1.69 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 171.7 +- 2.83 | 170.7 +- 2.71 | 171.3 +- 2.5 | 131.0 +- 1.89 | +0.35 +- 2.16 | -23.53 +- 1.57 | | 78b-2t1c-ethip6-ip6base | 46.6 +- 4.06 | 44.1 +- 0.74 | 44.4 +- 0.52 | 33.4 +- 0.7 | +0.68 +- 2.05 | -24.77 +- 1.8 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 61.2 +- 1.62 | 59.6 +- 1.51 | 60.3 +- 1.64 | 45.2 +- 1.03 | +1.17 +- 3.75 | -25.04 +- 2.66 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 51.6 +- 1.71 | 50.3 +- 1.34 | 49.9 +- 0.99 | 37.4 +- 0.7 | -0.8 +- 3.3 | -25.05 +- 2.05 | | 64b-2t1c-eth-l2bdbasemaclrn | 45.6 +- 0.7 | 44.5 +- 0.97 | 44.0 +- 0.67 | 32.4 +- 0.52 | -1.12 +- 2.63 | -26.36 +- 1.62 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 59.0 +- 1.56 | 51.3 +- 0.67 | 51.0 +- 0.67 | 37.4 +- 0.84 | -0.58 +- 1.84 | -26.67 +- 1.91 | | 64b-2t1c-ethip4-ip4scale20k | 52.3 +- 1.57 | 52.2 +- 1.03 | 51.9 +- 1.6 | 36.8 +- 1.23 | -0.57 +- 3.63 | -29.09 +- 3.22 | | 64b-2t1c-eth-l2patch | 31.5 +- 0.71 | 30.9 +- 0.88 | 30.7 +- 0.48 | 21.5 +- 0.71 | -0.65 +- 3.22 | -29.97 +- 2.55 | | 64b-2t1c-ethip4-ip4base | 68.6 +- 4.95 | 49.6 +- 4.17 | 47.3 +- 1.57 | 33.0 +- 0.47 | -4.64 +- 8.62 | -30.23 +- 2.52 | | 64b-2t1c-eth-l2xcbase | 42.2 +- 0.92 | 41.7 +- 0.82 | 41.2 +- 0.42 | 28.2 +- 0.63 | -1.2 +- 2.2 | -31.55 +- 1.69 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 63.2 +- 4.64 | 61.8 +- 4.26 | 64.5 +- 9.85 | 44.1 +- 1.6 | +4.37 +- 17.48 | -31.63 +- 10.73 | +--------------------------------------------------------------+----------------+----------------+----------------+----------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "8" for CSIT rls2110, "9" for CSIT rls2202). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2110.0-9 vs 2110.0-8: Compares CSIT environment current vs previous with previous VPP code. 2202.0-9 vs 2110.0-9: Compares VPP code current vs previous in the current CSIT environment.