+--------------------------------------------------------------+----------------+----------------+----------------+------------------------+ | Test Case | 2206.0-10 | 2210.0-11 | 2302.0-11 | 2302.0-11 vs 2210.0-11 | +--------------------------------------------------------------+----------------+----------------+----------------+------------------------+ | 64b-2t1c-af-xdp-ethip4-ip4scale20k | 16.1 +- 0.99 | 20.7 +- 9.14 | 29.1 +- 21.22 | +40.58 +- 119.85 | | 64b-2t1c-af-xdp-ethip4-ip4base | 19.2 +- 8.78 | 26.3 +- 16.83 | 35.3 +- 32.02 | +34.22 +- 149.02 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 40.6 +- 1.26 | 38.0 +- 0.67 | 45.2 +- 1.03 | +18.95 +- 3.43 | | 78b-2t1c-af-xdp-ethip6-ip6base | 19.7 +- 12.45 | 26.8 +- 22.92 | 31.1 +- 30.36 | +16.04 +- 150.61 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 134.7 +- 8.34 | 129.6 +- 8.66 | 145.2 +- 4.13 | +12.04 +- 8.13 | | 64b-2t1c-eth-l2bdbasemaclrn | 44.5 +- 1.43 | 40.2 +- 3.58 | 44.4 +- 2.67 | +10.45 +- 11.88 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 123.6 +- 4.12 | 106.2 +- 3.01 | 113.3 +- 4.5 | +6.69 +- 5.2 | | 64b-2t1c-avf-ethip4-ip4scale200k | 45.7 +- 1.77 | 44.4 +- 2.22 | 46.8 +- 1.87 | +5.41 +- 6.75 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 141.8 +- 9.0 | 128.0 +- 3.86 | 134.8 +- 2.86 | +5.31 +- 3.88 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k-rnd | 21.5 +- 8.76 | 24.6 +- 9.48 | 25.9 +- 11.54 | +5.28 +- 62.02 | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 43.8 +- 1.4 | 40.9 +- 1.85 | 42.9 +- 1.91 | +4.89 +- 6.67 | | 64b-2t1c-avf-ethip4-ip4base | 43.2 +- 1.87 | 41.1 +- 1.29 | 43.1 +- 2.08 | +4.87 +- 6.03 | | 78b-2t1c-ethip6-ip6base | 42.9 +- 1.52 | 39.3 +- 1.77 | 41.0 +- 1.25 | +4.33 +- 5.66 | | 78b-2t1c-ethip6-ip6scale20k | 44.2 +- 4.21 | 42.2 +- 5.29 | 43.8 +- 3.46 | +3.79 +- 15.37 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 48.0 +- 1.56 | 45.4 +- 2.27 | 47.0 +- 2.0 | +3.52 +- 6.8 | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 44.7 +- 2.06 | 42.4 +- 1.84 | 43.8 +- 3.12 | +3.3 +- 8.61 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 52.0 +- 3.3 | 48.2 +- 1.75 | 49.6 +- 2.55 | +2.9 +- 6.47 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 41.1 +- 1.52 | 39.2 +- 1.93 | 40.3 +- 1.34 | +2.81 +- 6.11 | | 64b-2t1c-avf-ethip4-ip4scale20k | 43.1 +- 0.88 | 43.4 +- 2.27 | 44.5 +- 1.9 | +2.53 +- 6.92 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 48.0 +- 2.75 | 46.1 +- 2.18 | 47.2 +- 2.49 | +2.39 +- 7.25 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 39.0 +- 3.27 | 39.9 +- 2.13 | 40.8 +- 2.53 | +2.26 +- 8.37 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 45.6 +- 3.1 | 43.7 +- 1.64 | 44.6 +- 1.71 | +2.06 +- 5.47 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 46.0 +- 4.03 | 41.9 +- 5.13 | 42.7 +- 3.83 | +1.91 +- 15.47 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 52.3 +- 2.54 | 49.6 +- 3.69 | 50.5 +- 2.68 | +1.81 +- 9.3 | | 64b-2t1c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir | 93.0 +- 2.26 | 88.6 +- 2.17 | 89.9 +- 2.6 | +1.47 +- 3.85 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 53.3 +- 5.14 | 52.3 +- 3.33 | 53.0 +- 4.74 | +1.34 +- 11.13 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 54.4 +- 5.5 | 45.4 +- 3.47 | 46.0 +- 2.83 | +1.32 +- 9.94 | | 64b-2t1c-eth-l2bdscale1mmaclrn | 55.5 +- 3.17 | 52.3 +- 2.83 | 52.8 +- 5.05 | +0.96 +- 11.1 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 54.9 +- 6.67 | 46.1 +- 9.1 | 46.4 +- 4.95 | +0.65 +- 22.58 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 143.6 +- 4.55 | 136.5 +- 4.43 | 137.1 +- 2.73 | +0.44 +- 3.82 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 39.5 +- 1.51 | 38.6 +- 2.07 | 38.7 +- 2.21 | +0.26 +- 7.85 | | 64b-2t1c-ethip4-ip4scale20k | 42.1 +- 1.1 | 39.1 +- 1.52 | 39.2 +- 1.4 | +0.26 +- 5.3 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 129.7 +- 10.29 | 123.9 +- 12.85 | 124.1 +- 10.21 | +0.16 +- 13.26 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 40.4 +- 0.84 | 39.1 +- 1.91 | 39.1 +- 0.88 | +0.0 +- 5.38 | | 78b-2t1c-avf-ethip6-ip6scale20k | 40.5 +- 2.42 | 40.1 +- 2.02 | 40.1 +- 1.6 | +0.0 +- 6.43 | | 64b-2t1c-avf-eth-l2xcbase | 37.5 +- 2.07 | 32.6 +- 0.52 | 32.4 +- 0.52 | -0.61 +- 2.23 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 130.4 +- 2.07 | 119.2 +- 3.99 | 118.2 +- 2.1 | -0.84 +- 3.76 | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 41.6 +- 2.55 | 40.8 +- 2.04 | 40.4 +- 2.01 | -0.98 +- 6.99 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 60.3 +- 8.43 | 46.8 +- 7.21 | 46.2 +- 5.2 | -1.28 +- 18.83 | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 44.4 +- 3.66 | 43.5 +- 2.51 | 42.9 +- 3.54 | -1.38 +- 9.93 | | 64b-2t1c-avf-eth-l2patch | 18.9 +- 0.74 | 18.6 +- 0.52 | 18.3 +- 0.48 | -1.61 +- 3.77 | | 78b-2t1c-avf-ethip6-ip6scale200k | 42.2 +- 2.78 | 42.9 +- 3.67 | 42.2 +- 2.44 | -1.63 +- 10.15 | | 64b-2t1c-avf-ethip4-ip4scale2m | 50.8 +- 6.51 | 56.9 +- 10.77 | 55.9 +- 14.08 | -1.76 +- 30.96 | | 64b-2t1c-eth-l2patch | 29.6 +- 1.26 | 28.3 +- 1.06 | 27.8 +- 1.32 | -1.77 +- 5.93 | | 64b-2t1c-ethip4-ip4base | 50.5 +- 6.2 | 53.2 +- 2.04 | 52.2 +- 1.87 | -1.88 +- 5.16 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 199.8 +- 43.52 | 216.9 +- 41.67 | 211.7 +- 25.05 | -2.4 +- 22.02 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 115.5 +- 9.62 | 120.2 +- 8.93 | 116.7 +- 7.17 | -2.91 +- 9.36 | | 64b-2t1c-eth-l2xcbase | 37.4 +- 1.58 | 35.7 +- 1.77 | 34.3 +- 0.67 | -3.92 +- 5.12 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 54.1 +- 7.71 | 55.1 +- 7.91 | 52.9 +- 6.06 | -3.99 +- 17.63 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 73.5 +- 14.07 | 64.2 +- 10.0 | 61.1 +- 11.14 | -4.83 +- 22.82 | | 78b-2t1c-avf-ethip6-ip6scale2m | 47.6 +- 7.15 | 44.0 +- 7.62 | 41.6 +- 3.6 | -5.45 +- 18.29 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 107.5 +- 14.64 | 113.6 +- 6.62 | 107.2 +- 4.42 | -5.63 +- 6.73 | | 78b-2t1c-avf-ethip6-ip6base | 45.1 +- 1.52 | 42.2 +- 1.48 | 39.7 +- 1.16 | -5.92 +- 4.29 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 170.4 +- 16.05 | 193.2 +- 10.09 | 173.9 +- 18.39 | -9.99 +- 10.61 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 91.6 +- 7.35 | 90.4 +- 2.27 | 80.1 +- 6.35 | -11.39 +- 7.37 | | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 51.2 +- 5.67 | 51.9 +- 7.14 | 45.6 +- 2.84 | -12.14 +- 13.27 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 178.3 +- 9.71 | 194.1 +- 22.8 | 169.6 +- 13.67 | -12.62 +- 12.45 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k-rnd | 16.5 +- 2.07 | 34.2 +- 23.01 | 24.1 +- 8.54 | -29.53 +- 53.59 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k | 16.0 +- 0.82 | 48.5 +- 43.9 | 25.0 +- 15.36 | -48.45 +- 56.39 | +--------------------------------------------------------------+----------------+----------------+----------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210 and rls2302). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2302.0-11 vs 2210.0-11: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.