+--------------------------------------------------------------+---------------+----------------+--------------+----------------------+----------------------+ | Test Case | 2101.0-6 | 2101.0-7 | 2106.0-7 | 2101.0-7 vs 2101.0-6 | 2106.0-7 vs 2101.0-7 | +--------------------------------------------------------------+---------------+----------------+--------------+----------------------+----------------------+ | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 268.8 +- 10.2 | 5511.2 +- 39.2 | 553.0 +- NaN | +1950.3 +- 79.0 | -90.0 +- NaN | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 153.5 +- 7.0 | 5213.2 +- 15.7 | 336.0 +- NaN | +3296.2 +- 154.4 | -93.6 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 220.8 +- 9.6 | 5250.4 +- 47.5 | 333.0 +- NaN | +2277.9 +- 105.5 | -93.7 +- NaN | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 133.5 +- 7.8 | 5215.4 +- 10.9 | 295.0 +- NaN | +3806.7 +- 228.6 | -94.3 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 186.1 +- 15.0 | 5243.6 +- 19.7 | 292.0 +- NaN | +2717.6 +- 227.8 | -94.4 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h262144-p63-s16515072 | 60.7 +- 3.3 | 5136.5 +- 49.8 | 280.0 +- NaN | +8360.1 +- 467.4 | -94.5 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 148.2 +- 8.6 | 5206.6 +- 19.1 | 271.0 +- NaN | +3413.2 +- 203.4 | -94.8 +- NaN | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 152.6 +- 10.7 | 5184.0 +- 10.0 | 267.0 +- NaN | +3297.1 +- 238.3 | -94.8 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 181.1 +- 8.8 | 5179.5 +- 7.3 | 266.0 +- NaN | +2760.0 +- 138.4 | -94.9 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 112.8 +- 3.6 | 5179.4 +- 11.3 | 260.0 +- NaN | +4491.7 +- 147.5 | -95.0 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 125.2 +- 3.5 | 5199.4 +- 4.1 | 254.0 +- NaN | +4052.9 +- 115.8 | -95.1 +- NaN | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 129.5 +- 24.4 | 5122.5 +- 16.9 | 246.0 +- NaN | +3855.6 +- 744.7 | -95.2 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 189.2 +- 10.8 | 5205.5 +- 52.4 | 248.0 +- NaN | +2651.3 +- 158.9 | -95.2 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale200k | 62.8 +- 2.5 | 5090.7 +- 52.4 | 205.0 +- NaN | +8006.2 +- 337.1 | -96.0 +- NaN | | 64b-2t1c-eth-l2bdscale1mmaclrn | 226.5 +- 39.2 | 5120.8 +- 14.1 | 189.0 +- NaN | +2160.8 +- 391.8 | -96.3 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 162.7 +- 27.4 | 5118.5 +- 14.2 | 187.0 +- NaN | +3046.0 +- 529.2 | -96.3 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 246.0 +- 8.3 | 5123.2 +- 20.6 | 182.0 +- NaN | +1982.6 +- 70.4 | -96.4 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 175.0 +- 6.6 | 5125.2 +- 8.7 | 170.0 +- NaN | +2828.7 +- 110.8 | -96.7 +- NaN | | 64b-2t1c-eth-l2bdscale100kmaclrn | 124.7 +- 13.8 | 5086.6 +- 14.4 | 151.0 +- NaN | +3979.1 +- 453.2 | -97.0 +- NaN | | 78b-2t1c-ethip6-ip6scale200k | 73.4 +- 4.8 | 5052.7 +- 7.6 | 146.0 +- NaN | +6783.8 +- 451.4 | -97.1 +- NaN | | 78b-2t1c-ethip6-ip6scale2m-rnd | 89.9 +- 6.4 | 5087.2 +- 13.3 | 140.0 +- NaN | +5558.7 +- 403.3 | -97.2 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 95.0 +- 4.5 | 5071.9 +- 5.4 | 139.0 +- NaN | +5238.8 +- 254.2 | -97.3 +- NaN | | 64b-2t1c-ethip4-ip4scale2m-rnd | 67.8 +- 3.2 | 5073.0 +- 8.0 | 139.0 +- NaN | +7382.3 +- 352.3 | -97.3 +- NaN | | 64b-2t1c-ethip4-ip4base | 49.6 +- 8.2 | 5073.6 +- 41.8 | 137.0 +- NaN | +10129.0 +- 1703.3 | -97.3 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale2m | 70.5 +- 2.5 | 5078.0 +- 11.2 | 135.0 +- NaN | +7102.8 +- 251.9 | -97.3 +- NaN | | 78b-2t1c-ethip6-ip6scale200k-rnd | 79.9 +- 6.5 | 5084.5 +- 8.0 | 132.0 +- NaN | +6263.6 +- 514.1 | -97.4 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 72.3 +- 4.2 | 5073.9 +- 4.2 | 128.0 +- NaN | +6917.8 +- 406.9 | -97.5 +- NaN | | 78b-2t1c-ethip6-ip6scale20k-rnd | 74.4 +- 12.3 | 5078.3 +- 8.4 | 126.0 +- NaN | +6725.7 +- 1130.5 | -97.5 +- NaN | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 51.4 +- 1.6 | 5063.3 +- 15.5 | 123.0 +- NaN | +9750.8 +- 303.8 | -97.6 +- NaN | | 78b-2t1c-ethip6-ip6scale2m | 77.6 +- 3.1 | 5051.7 +- 6.9 | 122.0 +- NaN | +6409.9 +- 257.1 | -97.6 +- NaN | | 64b-2t1c-ethip4-ip4scale20k-rnd | 49.1 +- 7.4 | 5056.4 +- 7.7 | 118.0 +- NaN | +10198.2 +- 1561.7 | -97.7 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 76.7 +- 7.1 | 5103.2 +- 72.5 | 117.0 +- NaN | +6553.5 +- 622.0 | -97.7 +- NaN | | 64b-2t1c-ethip4-ip4scale200k-rnd | 57.2 +- 7.3 | 5053.5 +- 6.2 | 115.0 +- NaN | +8734.8 +- 1132.2 | -97.7 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 48.7 +- 2.5 | 5046.3 +- 2.8 | 110.0 +- NaN | +10262.0 +- 540.6 | -97.8 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 64.3 +- 4.2 | 5053.2 +- 4.7 | 109.0 +- NaN | +7758.8 +- 515.5 | -97.8 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 64.8 +- 3.6 | 5066.4 +- 6.6 | 109.0 +- NaN | +7718.5 +- 436.3 | -97.8 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale2m | 51.6 +- 1.6 | 5054.5 +- 20.7 | 106.0 +- NaN | +9695.5 +- 302.2 | -97.9 +- NaN | | 78b-2t1c-avf-ethip6-ip6base | 48.3 +- 2.9 | 5045.1 +- 5.4 | 104.0 +- NaN | +10345.3 +- 628.9 | -97.9 +- NaN | | 64b-2t1c-ethip4-ip4scale20k | 49.4 +- 8.1 | 5054.7 +- 8.2 | 104.0 +- NaN | +10132.2 +- 1686.2 | -97.9 +- NaN | | 78b-2t1c-ethip6-ip6scale20k | 73.5 +- 11.0 | 5062.7 +- 6.9 | 104.0 +- NaN | +6788.0 +- 1029.7 | -97.9 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale200k | 50.3 +- 2.0 | 5047.7 +- 3.8 | 97.0 +- NaN | +9928.5 +- 398.6 | -98.1 +- NaN | | 64b-2t1c-ethip4-ip4scale200k | 90.0 +- 56.7 | 5056.0 +- 7.7 | 96.0 +- NaN | +5517.8 +- 3538.4 | -98.1 +- NaN | | 64b-2t1c-eth-l2bdscale10kmaclrn | 51.4 +- 4.9 | 5061.8 +- 28.9 | 96.0 +- NaN | +9747.9 +- 932.5 | -98.1 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale20k | 45.0 +- 1.6 | 5042.5 +- 5.5 | 92.0 +- NaN | +11105.6 +- 389.5 | -98.2 +- NaN | | 64b-2t1c-ethip4-ip4scale2m | 83.8 +- 61.4 | 5053.3 +- 5.9 | 92.0 +- NaN | +5930.2 +- 4419.7 | -98.2 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 57.5 +- 4.5 | 5062.8 +- 26.0 | 92.0 +- NaN | +8704.9 +- 694.8 | -98.2 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn | 46.5 +- 2.9 | 5047.1 +- 8.0 | 91.0 +- NaN | +10754.0 +- 680.7 | -98.2 +- NaN | | 78b-2t1c-ethip6-ip6base | 54.2 +- 12.3 | 5046.5 +- 0.8 | 89.0 +- NaN | +9210.9 +- 2117.6 | -98.2 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 62.0 +- 3.3 | 5060.8 +- 6.0 | 89.0 +- NaN | +8062.6 +- 439.0 | -98.2 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 49.0 +- 1.4 | 5043.5 +- 2.0 | 88.0 +- NaN | +10192.9 +- 297.1 | -98.3 +- NaN | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 51.6 +- 1.7 | 5058.9 +- 34.5 | 88.0 +- NaN | +9704.1 +- 332.2 | -98.3 +- NaN | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 47.2 +- 2.0 | 5048.9 +- 15.0 | 85.0 +- NaN | +10596.8 +- 451.8 | -98.3 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 58.1 +- 1.9 | 5061.3 +- 4.2 | 85.0 +- NaN | +8611.4 +- 277.9 | -98.3 +- NaN | | 64b-2t1c-eth-l2xcbase | 42.3 +- 3.4 | 5080.5 +- 88.8 | 85.0 +- NaN | +11910.6 +- 988.2 | -98.3 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale20k | 48.3 +- 1.6 | 5050.6 +- 6.0 | 84.0 +- NaN | +10356.7 +- 354.5 | -98.3 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 45.0 +- 2.4 | 5067.1 +- 88.0 | 82.0 +- NaN | +11160.2 +- 621.3 | -98.4 +- NaN | | 64b-2t1c-avf-ethip4-ip4base | 45.2 +- 1.2 | 5040.3 +- 3.2 | 79.0 +- NaN | +11051.1 +- 303.3 | -98.4 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 45.4 +- 0.7 | 5040.4 +- 6.6 | 71.0 +- NaN | +11002.2 +- 171.6 | -98.6 +- NaN | | 64b-2t1c-avf-eth-l2xcbase | 40.4 +- 1.3 | 5043.7 +- 42.4 | 67.0 +- NaN | +12384.4 +- 430.1 | -98.7 +- NaN | | 64b-2t1c-eth-l2patch | 36.1 +- 2.8 | 5026.1 +- 4.1 | 55.0 +- NaN | +13822.7 +- 1082.5 | -98.9 +- NaN | | 64b-2t1c-avf-eth-l2patch | 27.6 +- 1.3 | 5016.4 +- 1.5 | 37.0 +- NaN | +18075.4 +- 833.0 | -99.3 +- NaN | +--------------------------------------------------------------+---------------+----------------+--------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "6" for CSIT rls2101, "7" for CSIT rls2106). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2101.0-7 vs 2101.0-6: Compares CSIT environment current vs previous with previous VPP code. 2106.0-7 vs 2101.0-7: Compares VPP code current vs previous in the current CSIT environment.