+--------------------------------------------------------------+----------------+----------------+----------------+------------------------+ | Test Case | 2206.0-10 | 2210.0-11 | 2302.0-11 | 2302.0-11 vs 2210.0-11 | +--------------------------------------------------------------+----------------+----------------+----------------+------------------------+ | 78b-2t1c-ethip6-ip6scale20k | 55.4 +- 5.1 | 49.2 +- 5.59 | 54.6 +- 13.39 | +10.98 +- 30.0 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 42.6 +- 2.55 | 41.7 +- 5.44 | 45.6 +- 3.92 | +9.35 +- 17.08 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 40.2 +- 1.93 | 40.0 +- 1.33 | 42.2 +- 4.13 | +5.5 +- 10.91 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 33.9 +- 1.2 | 34.6 +- 3.6 | 36.5 +- 2.07 | +5.49 +- 12.49 | | 78b-2t1c-avf-ethip6-ip6base | 37.2 +- 1.4 | 39.3 +- 3.16 | 41.4 +- 4.97 | +5.34 +- 15.23 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 157.5 +- 12.63 | 168.5 +- 14.33 | 175.8 +- 27.34 | +4.33 +- 18.5 | | 64b-2t1c-avf-ethip4-ip4scale20k | 38.9 +- 1.66 | 38.6 +- 1.26 | 39.8 +- 1.48 | +3.11 +- 5.1 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 45.1 +- 2.42 | 44.6 +- 0.97 | 45.9 +- 2.81 | +2.91 +- 6.68 | | 64b-2t1c-avf-ethip4udp-nat44det-h262144-p63-s16515072 | 61.0 +- 8.72 | 60.88 +- 7.49 | 62.62 +- 11.59 | +2.87 +- 22.86 | | 78b-2t1c-avf-ethip6-ip6scale20k | 38.5 +- 1.27 | 39.8 +- 1.23 | 40.9 +- 4.38 | +2.76 +- 11.46 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 99.4 +- 3.17 | 94.2 +- 3.74 | 96.5 +- 6.06 | +2.44 +- 7.61 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 132.8 +- 4.05 | 125.4 +- 3.34 | 128.3 +- 8.94 | +2.31 +- 7.64 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 47.6 +- 2.12 | 46.4 +- 2.01 | 47.2 +- 2.3 | +1.72 +- 6.63 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 39.3 +- 1.34 | 38.0 +- 1.25 | 38.6 +- 1.78 | +1.58 +- 5.74 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 41.7 +- 1.83 | 39.1 +- 1.66 | 39.7 +- 1.49 | +1.53 +- 5.77 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 42.6 +- 1.71 | 40.2 +- 1.48 | 40.7 +- 2.16 | +1.24 +- 6.54 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 43.5 +- 2.22 | 43.6 +- 2.01 | 44.0 +- 3.59 | +0.92 +- 9.46 | | 64b-2t1c-eth-l2patch | 23.8 +- 0.79 | 23.8 +- 0.63 | 24.0 +- 0.47 | +0.84 +- 3.33 | | 64b-2t1c-avf-ethip4-ip4base | 40.8 +- 1.69 | 38.6 +- 1.17 | 38.9 +- 1.37 | +0.78 +- 4.69 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 38.5 +- 1.27 | 40.7 +- 1.34 | 41.0 +- 1.7 | +0.74 +- 5.33 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 41.9 +- 1.29 | 42.8 +- 1.81 | 43.0 +- 1.89 | +0.47 +- 6.13 | | 64b-2t1c-ethip4-ip4base | 51.5 +- 5.1 | 55.1 +- 4.38 | 55.2 +- 4.78 | +0.18 +- 11.78 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 126.9 +- 4.89 | 142.7 +- 2.71 | 142.8 +- 4.78 | +0.07 +- 3.85 | | 64b-2t1c-avf-eth-l2xcbase | 31.1 +- 0.88 | 30.3 +- 1.34 | 30.3 +- 0.95 | +0.0 +- 5.41 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 178.6 +- 37.52 | 158.6 +- 23.76 | 157.9 +- 20.65 | -0.44 +- 19.8 | | 64b-2t1c-avf-eth-l2patch | 18.4 +- 0.52 | 18.3 +- 0.48 | 18.2 +- 0.42 | -0.55 +- 3.49 | | 78b-2t1c-ethip6-ip6base | 43.2 +- 1.32 | 43.3 +- 2.21 | 43.0 +- 1.83 | -0.69 +- 6.6 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 115.4 +- 5.82 | 118.3 +- 4.67 | 116.1 +- 1.79 | -1.86 +- 4.16 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 59.2 +- 7.0 | 66.1 +- 9.41 | 64.6 +- 12.71 | -2.27 +- 23.74 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 53.6 +- 1.43 | 52.8 +- 2.25 | 51.4 +- 1.43 | -2.65 +- 4.96 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 128.5 +- 2.12 | 137.8 +- 3.22 | 133.5 +- 2.95 | -3.12 +- 3.12 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 118.6 +- 4.48 | 121.4 +- 3.06 | 117.6 +- 3.98 | -3.13 +- 4.09 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 38.7 +- 1.57 | 39.2 +- 2.3 | 37.9 +- 1.73 | -3.32 +- 7.19 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 113.7 +- 3.02 | 113.3 +- 3.16 | 109.5 +- 7.75 | -3.35 +- 7.35 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 85.5 +- 4.7 | 87.0 +- 7.51 | 83.5 +- 4.35 | -4.02 +- 9.68 | | 64b-2t1c-ethip4-ip4scale20k | 45.0 +- 2.16 | 52.4 +- 5.27 | 49.5 +- 2.95 | -5.53 +- 11.05 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 80.2 +- 2.78 | 78.7 +- 2.67 | 73.6 +- 5.68 | -6.48 +- 7.88 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 45.3 +- 2.41 | 51.0 +- 2.67 | 46.7 +- 2.31 | -8.43 +- 6.59 | | 64b-2t1c-eth-l2bdbasemaclrn | 38.4 +- 1.51 | 40.0 +- 2.05 | 36.4 +- 1.17 | -9.0 +- 5.52 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 50.6 +- 6.5 | 50.4 +- 7.41 | 45.0 +- 1.56 | -10.71 +- 13.49 | | 64b-2t1c-eth-l2xcbase | 39.3 +- 1.77 | 42.4 +- 1.35 | 35.9 +- 1.2 | -15.33 +- 3.9 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 151.1 +- 12.7 | 136.0 +- 11.95 | 113.8 +- 3.77 | -16.32 +- 7.86 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 45.5 +- 3.06 | 50.4 +- 4.84 | 40.8 +- 1.48 | -19.05 +- 8.3 | +--------------------------------------------------------------+----------------+----------------+----------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210 and rls2302). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2302.0-11 vs 2210.0-11: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.