+--------------------------------------------------------------+---------------+-----------------+--------------+----------------------+----------------------+ | Test Case | 2101.0-6 | 2101.0-7 | 2106.0-7 | 2101.0-7 vs 2101.0-6 | 2106.0-7 vs 2101.0-7 | +--------------------------------------------------------------+---------------+-----------------+--------------+----------------------+----------------------+ | 78b-2t1c-ethip6-ip6scale200k | 134.7 +- 82.8 | 5050.8 +- 7.8 | 484.0 +- NaN | +3649.6 +- 2304.4 | -90.4 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 165.1 +- 23.1 | 5286.4 +- 92.9 | 434.0 +- NaN | +3102.0 +- 451.3 | -91.8 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 215.5 +- 12.8 | 5224.4 +- 22.1 | 410.0 +- NaN | +2324.3 +- 143.9 | -92.2 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h262144-p63-s16515072 | 84.7 +- 11.7 | 5126.4 +- 29.3 | 354.0 +- NaN | +5952.5 +- 835.4 | -93.1 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 145.7 +- 12.9 | 5183.4 +- 34.2 | 348.0 +- NaN | +3457.6 +- 316.1 | -93.3 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 169.5 +- 4.3 | 5244.8 +- 12.0 | 344.0 +- NaN | +2994.3 +- 79.3 | -93.4 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 205.6 +- 12.9 | 5216.4 +- 9.9 | 321.0 +- NaN | +2437.2 +- 159.7 | -93.8 +- NaN | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 185.5 +- 4.4 | 5182.2 +- 9.6 | 316.0 +- NaN | +2693.7 +- 65.8 | -93.9 +- NaN | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 262.6 +- 13.9 | 5205.3 +- 13.0 | 311.0 +- NaN | +1882.2 +- 105.0 | -94.0 +- NaN | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 91.7 +- 31.3 | 5057.4 +- 3.8 | 258.0 +- NaN | +5417.2 +- 1881.1 | -94.9 +- NaN | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 158.3 +- 17.6 | 5166.2 +- 10.0 | 228.0 +- NaN | +3163.6 +- 362.4 | -95.6 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 120.5 +- 6.1 | 5174.2 +- 9.7 | 223.0 +- NaN | +4194.0 +- 217.4 | -95.7 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 164.6 +- 11.3 | 5154.9 +- 8.1 | 217.0 +- NaN | +3031.8 +- 214.8 | -95.8 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 265.4 +- 11.7 | 5138.6 +- 26.8 | 215.0 +- NaN | +1836.2 +- 86.3 | -95.8 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44ed-h262144-p63-s16515072-udir | 135.4 +- 12.6 | 5103.8 +- 8.3 | 185.0 +- NaN | +3669.4 +- 350.5 | -96.4 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 100.5 +- 7.0 | 5134.6 +- 16.1 | 185.0 +- NaN | +5009.0 +- 356.8 | -96.4 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44ed-h65536-p63-s4128768-udir | 155.7 +- 25.0 | 5113.6 +- 21.0 | 182.0 +- NaN | +3184.2 +- 528.2 | -96.4 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 150.0 +- 36.6 | 5140.6 +- 68.1 | 164.0 +- NaN | +3327.0 +- 837.0 | -96.8 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44ed-h16384-p63-s1032192-udir | 193.6 +- 21.6 | 5356.7 +- 701.9 | 159.0 +- NaN | +2666.9 +- 475.9 | -97.0 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 85.2 +- 37.9 | 5093.3 +- 77.9 | 147.0 +- NaN | +5878.1 +- 2659.0 | -97.1 +- NaN | | 64b-2t1c-eth-l2bdscale1mmaclrn | 98.8 +- 23.4 | 5186.2 +- 157.7 | 149.0 +- NaN | +5149.2 +- 1254.4 | -97.1 +- NaN | | 78b-2t1c-ethip6-ip6scale200k-rnd | 119.8 +- 77.2 | 5105.0 +- 123.2 | 142.0 +- NaN | +4161.3 +- 2746.7 | -97.2 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 68.4 +- 3.6 | 5064.6 +- 4.7 | 139.0 +- NaN | +7304.3 +- 392.7 | -97.3 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir | 109.3 +- 4.4 | 5072.9 +- 7.6 | 133.0 +- NaN | +4541.3 +- 185.8 | -97.4 +- NaN | | 64b-2t1c-eth-l2bdscale100kmaclrn | 70.8 +- 9.4 | 5062.7 +- 8.2 | 128.0 +- NaN | +7050.7 +- 944.9 | -97.5 +- NaN | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 48.2 +- 5.3 | 5040.2 +- 3.5 | 127.0 +- NaN | +10356.9 +- 1142.5 | -97.5 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 117.7 +- 53.9 | 5076.9 +- 6.5 | 126.0 +- NaN | +4213.4 +- 1975.1 | -97.5 +- NaN | | 64b-2t1c-eth-l2bdscale10kmaclrn | 67.1 +- 5.7 | 5081.9 +- 8.4 | 121.0 +- NaN | +7473.6 +- 639.6 | -97.6 +- NaN | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 56.5 +- 3.1 | 5048.8 +- 3.4 | 120.0 +- NaN | +8835.9 +- 496.0 | -97.6 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 52.5 +- 2.2 | 5062.0 +- 51.1 | 120.0 +- NaN | +9541.9 +- 419.8 | -97.6 +- NaN | | 64b-2t1c-ethip4-ip4scale200k-rnd | 58.9 +- 3.6 | 5095.3 +- 121.9 | 118.0 +- NaN | +8550.8 +- 564.1 | -97.7 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale200k | 85.4 +- 24.5 | 5090.1 +- 86.9 | 113.0 +- NaN | +5860.3 +- 1712.0 | -97.8 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 177.7 +- 47.0 | 5070.9 +- 6.7 | 111.0 +- NaN | +2753.6 +- 754.6 | -97.8 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale2m | 96.4 +- 18.5 | 5072.4 +- 31.6 | 109.0 +- NaN | +5161.9 +- 1012.6 | -97.9 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn | 59.4 +- 2.8 | 5048.8 +- 16.5 | 99.0 +- NaN | +8399.6 +- 406.8 | -98.0 +- NaN | | 78b-2t1c-ethip6-ip6scale2m-rnd | 81.5 +- 5.0 | 5103.2 +- 71.4 | 100.0 +- NaN | +6161.6 +- 393.6 | -98.0 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 43.7 +- 1.6 | 5041.6 +- 7.0 | 96.0 +- NaN | +11436.7 +- 432.3 | -98.1 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale200k | 49.1 +- 2.6 | 5042.4 +- 9.3 | 95.0 +- NaN | +10169.7 +- 535.4 | -98.1 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 64.6 +- 2.9 | 5048.6 +- 5.3 | 92.0 +- NaN | +7715.1 +- 347.9 | -98.2 +- NaN | | 64b-2t1c-avf-ethip4-ip4base | 48.0 +- 3.7 | 5035.2 +- 2.3 | 90.0 +- NaN | +10390.0 +- 817.7 | -98.2 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 72.7 +- 3.7 | 5054.9 +- 2.1 | 90.0 +- NaN | +6853.1 +- 349.4 | -98.2 +- NaN | | 64b-2t1c-ethip4-ip4scale2m | 61.3 +- 3.5 | 5049.4 +- 4.7 | 89.0 +- NaN | +8137.3 +- 470.1 | -98.2 +- NaN | | 78b-2t1c-ethip6-ip6scale20k-rnd | 54.3 +- 3.3 | 5080.0 +- 88.0 | 87.0 +- NaN | +9255.4 +- 585.8 | -98.3 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 69.3 +- 1.5 | 5061.7 +- 8.6 | 86.0 +- NaN | +7204.0 +- 158.0 | -98.3 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 50.0 +- 3.6 | 5048.8 +- 8.2 | 85.0 +- NaN | +9997.6 +- 731.4 | -98.3 +- NaN | | 64b-2t1c-ethip4-ip4scale20k-rnd | 57.0 +- 2.4 | 5044.0 +- 6.6 | 84.0 +- NaN | +8749.1 +- 373.3 | -98.3 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale20k | 48.2 +- 2.5 | 5039.4 +- 3.8 | 82.0 +- NaN | +10355.3 +- 539.2 | -98.4 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale2m | 54.1 +- 3.7 | 5047.7 +- 8.1 | 81.0 +- NaN | +9230.3 +- 632.3 | -98.4 +- NaN | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 56.4 +- 2.2 | 5047.8 +- 5.0 | 81.0 +- NaN | +8850.0 +- 352.6 | -98.4 +- NaN | | 78b-2t1c-ethip6-ip6base | 49.1 +- 2.5 | 5039.4 +- 3.0 | 79.0 +- NaN | +10163.6 +- 516.3 | -98.4 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 62.5 +- 2.3 | 5045.7 +- 3.1 | 79.0 +- NaN | +7973.1 +- 293.6 | -98.4 +- NaN | | 64b-2t1c-ethip4-ip4scale2m-rnd | 60.3 +- 3.5 | 5049.0 +- 4.8 | 78.0 +- NaN | +8273.1 +- 481.3 | -98.5 +- NaN | | 64b-2t1c-ethip4-ip4base | 53.0 +- 1.3 | 5057.7 +- 15.9 | 78.0 +- NaN | +9442.8 +- 241.9 | -98.5 +- NaN | | 64b-2t1c-ethip4-ip4scale200k | 55.2 +- 2.1 | 5041.6 +- 4.8 | 77.0 +- NaN | +9033.3 +- 355.8 | -98.5 +- NaN | | 64b-2t1c-ethip4-ip4scale20k | 55.1 +- 2.3 | 5034.1 +- 2.8 | 75.0 +- NaN | +9036.3 +- 386.5 | -98.5 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 44.6 +- 3.1 | 5037.0 +- 7.2 | 74.0 +- NaN | +11193.7 +- 793.8 | -98.5 +- NaN | | 64b-2t1c-eth-l2xcbase | 43.0 +- 1.2 | 5038.1 +- 5.3 | 74.0 +- NaN | +11616.5 +- 314.9 | -98.5 +- NaN | | 78b-2t1c-avf-ethip6-ip6base | 43.1 +- 2.1 | 5043.3 +- 6.3 | 74.0 +- NaN | +11601.5 +- 564.6 | -98.5 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 43.1 +- 1.9 | 5037.1 +- 3.7 | 69.0 +- NaN | +11587.0 +- 518.5 | -98.6 +- NaN | | 78b-2t1c-ethip6-ip6scale20k | 55.1 +- 3.3 | 5039.6 +- 6.9 | 69.0 +- NaN | +9046.2 +- 544.8 | -98.6 +- NaN | | 78b-2t1c-ethip6-ip6scale2m | 96.4 +- 13.6 | 5047.1 +- 7.4 | 69.0 +- NaN | +5135.6 +- 740.8 | -98.6 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale20k | 50.3 +- 4.5 | 5042.0 +- 6.4 | 64.0 +- NaN | +9923.9 +- 901.4 | -98.7 +- NaN | | 64b-2t1c-avf-eth-l2xcbase | 34.5 +- 1.8 | 5030.0 +- 4.1 | 56.0 +- NaN | +14479.7 +- 778.1 | -98.9 +- NaN | | 64b-2t1c-eth-l2patch | 34.2 +- 1.2 | 5022.8 +- 4.0 | 51.0 +- NaN | +14586.5 +- 528.0 | -99.0 +- NaN | | 64b-2t1c-avf-eth-l2patch | 24.7 +- 1.8 | 5008.8 +- 2.4 | 34.0 +- NaN | +20178.5 +- 1450.7 | -99.3 +- NaN | +--------------------------------------------------------------+---------------+-----------------+--------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "6" for CSIT rls2101, "7" for CSIT rls2106). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2101.0-7 vs 2101.0-6: Compares CSIT environment current vs previous with previous VPP code. 2106.0-7 vs 2101.0-7: Compares VPP code current vs previous in the current CSIT environment.