+--------------------------------------------------------------+-------------+---------------+-------------+----------------------+----------------------+ | Test Case | 2101.0-6 | 2101.0-7 | 2106.0-7 | 2101.0-7 vs 2101.0-6 | 2106.0-7 vs 2101.0-7 | +--------------------------------------------------------------+-------------+---------------+-------------+----------------------+----------------------+ | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 53.2 +- 4.4 | 1789.7 +- 3.0 | 78.0 +- NaN | +3264.1 +- 277.8 | -95.6 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 42.3 +- 4.1 | 1769.6 +- 3.9 | 67.0 +- NaN | +4083.5 +- 409.3 | -96.2 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 47.6 +- 3.8 | 1781.5 +- 2.8 | 65.0 +- NaN | +3642.6 +- 297.0 | -96.4 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 34.1 +- 2.8 | 1779.4 +- 2.8 | 53.0 +- NaN | +5118.2 +- 429.6 | -97.0 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 45.6 +- 4.1 | 1769.6 +- 2.7 | 48.0 +- NaN | +3780.7 +- 352.5 | -97.3 +- NaN | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 37.5 +- 2.3 | 1776.1 +- 5.4 | 48.0 +- NaN | +4636.3 +- 293.5 | -97.3 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 37.6 +- 3.9 | 1764.9 +- 2.9 | 47.0 +- NaN | +4593.9 +- 482.5 | -97.3 +- NaN | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 40.1 +- 3.7 | 1767.7 +- 4.0 | 47.0 +- NaN | +4308.2 +- 409.6 | -97.3 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 42.5 +- 4.2 | 1774.3 +- 3.7 | 47.0 +- NaN | +4074.8 +- 417.5 | -97.4 +- NaN | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 35.4 +- 1.5 | 1763.7 +- 2.6 | 45.0 +- NaN | +4882.2 +- 212.0 | -97.4 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 23.2 +- 6.0 | 1743.0 +- 2.5 | 43.0 +- NaN | +7412.9 +- 1947.8 | -97.5 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 34.0 +- 1.2 | 1773.5 +- 3.8 | 43.0 +- NaN | +5116.2 +- 191.7 | -97.6 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 38.3 +- 2.3 | 1768.5 +- 3.6 | 42.0 +- NaN | +4517.5 +- 278.9 | -97.6 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 20.7 +- 3.4 | 1744.0 +- 2.1 | 40.0 +- NaN | +8325.1 +- 1370.9 | -97.7 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h262144-p63-s16515072 | 22.6 +- 4.3 | 1744.1 +- 2.4 | 35.0 +- NaN | +7627.0 +- 1477.2 | -98.0 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 19.7 +- 0.8 | 1744.7 +- 2.1 | 31.0 +- NaN | +8756.3 +- 370.3 | -98.2 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 19.7 +- 1.2 | 1744.7 +- 1.8 | 27.0 +- NaN | +8756.3 +- 521.3 | -98.5 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 21.5 +- 2.3 | 1745.9 +- 4.1 | 27.0 +- NaN | +8020.5 +- 858.7 | -98.5 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 18.8 +- 0.6 | 1743.1 +- 2.0 | 26.0 +- NaN | +9171.8 +- 312.1 | -98.5 +- NaN | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 17.4 +- 1.9 | 1744.7 +- 2.1 | 26.0 +- NaN | +9927.0 +- 1093.5 | -98.5 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn | 18.7 +- 1.1 | 1740.5 +- 2.2 | 25.0 +- NaN | +9207.5 +- 527.4 | -98.6 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale200k | 19.0 +- 1.8 | 1742.3 +- 1.7 | 25.0 +- NaN | +9070.0 +- 870.1 | -98.6 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 19.3 +- 0.5 | 1742.7 +- 1.9 | 25.0 +- NaN | +8929.5 +- 226.2 | -98.6 +- NaN | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 18.4 +- 0.5 | 1743.7 +- 1.6 | 25.0 +- NaN | +9376.6 +- 266.1 | -98.6 +- NaN | | 64b-2t1c-eth-l2bdscale100kmaclrn | 20.8 +- 1.0 | 1744.0 +- 1.6 | 25.0 +- NaN | +8284.6 +- 416.4 | -98.6 +- NaN | | 64b-2t1c-eth-l2bdscale1mmaclrn | 22.8 +- 0.9 | 1746.7 +- 2.8 | 25.0 +- NaN | +7561.0 +- 309.0 | -98.6 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale200k | 19.4 +- 1.0 | 2272.5 +- 1.8 | 32.0 +- NaN | +11613.9 +- 583.4 | -98.6 +- NaN | | 64b-2t1c-ethip4-ip4scale20k | 19.0 +- 0.8 | 1739.9 +- 1.9 | 24.0 +- NaN | +9057.4 +- 393.6 | -98.6 +- NaN | | 64b-2t1c-ethip4-ip4scale200k | 19.1 +- 0.7 | 1740.0 +- 1.3 | 24.0 +- NaN | +9009.9 +- 352.0 | -98.6 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale2m | 17.1 +- 2.3 | 1741.2 +- 0.6 | 24.0 +- NaN | +10082.5 +- 1359.3 | -98.6 +- NaN | | 64b-2t1c-eth-l2bdscale10kmaclrn | 19.3 +- 0.9 | 1742.2 +- 1.6 | 24.0 +- NaN | +8926.9 +- 443.8 | -98.6 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 19.4 +- 0.5 | 1743.3 +- 1.1 | 24.0 +- NaN | +8886.1 +- 239.3 | -98.6 +- NaN | | 64b-2t1c-ethip4-ip4scale20k-rnd | 18.8 +- 0.4 | 1739.6 +- 1.2 | 23.0 +- NaN | +9153.2 +- 207.6 | -98.7 +- NaN | | 64b-2t1c-ethip4-ip4scale2m | 19.3 +- 0.8 | 1741.4 +- 1.5 | 23.0 +- NaN | +8922.8 +- 385.0 | -98.7 +- NaN | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 17.9 +- 0.6 | 1742.0 +- 0.8 | 23.0 +- NaN | +9631.8 +- 308.7 | -98.7 +- NaN | | 64b-2t1c-ethip4-ip4scale200k-rnd | 20.1 +- 1.2 | 1742.2 +- 1.7 | 23.0 +- NaN | +8567.7 +- 516.3 | -98.7 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 19.6 +- 1.4 | 2274.2 +- 1.5 | 30.0 +- NaN | +11503.1 +- 846.5 | -98.7 +- NaN | | 64b-2t1c-ethip4-ip4base | 18.8 +- 1.0 | 1739.4 +- 1.1 | 22.0 +- NaN | +9152.1 +- 508.3 | -98.7 +- NaN | | 64b-2t1c-avf-ethip4-ip4base | 17.3 +- 0.5 | 1740.3 +- 2.1 | 22.0 +- NaN | +9959.5 +- 281.1 | -98.7 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 17.8 +- 1.5 | 1740.9 +- 1.8 | 22.0 +- NaN | +9680.3 +- 810.9 | -98.7 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 17.8 +- 0.8 | 1741.1 +- 1.0 | 22.0 +- NaN | +9681.5 +- 433.5 | -98.7 +- NaN | | 64b-2t1c-ethip4-ip4scale2m-rnd | 22.4 +- 1.2 | 1742.8 +- 1.2 | 22.0 +- NaN | +7680.4 +- 407.7 | -98.7 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 17.7 +- 0.5 | 1741.0 +- 2.1 | 21.0 +- NaN | +9736.2 +- 268.7 | -98.8 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale20k | 17.4 +- 0.8 | 1741.5 +- 2.2 | 21.0 +- NaN | +9908.6 +- 485.2 | -98.8 +- NaN | | 64b-2t1c-avf-eth-l2xcbase | 16.9 +- 0.3 | 1741.8 +- 2.1 | 21.0 +- NaN | +10206.5 +- 193.3 | -98.8 +- NaN | | 78b-2t1c-ethip6-ip6scale20k | 19.5 +- 0.7 | 2270.9 +- 1.7 | 27.0 +- NaN | +11545.6 +- 422.4 | -98.8 +- NaN | | 78b-2t1c-ethip6-ip6scale20k-rnd | 21.4 +- 1.3 | 2271.9 +- 1.4 | 27.0 +- NaN | +10516.4 +- 627.5 | -98.8 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 20.8 +- 1.1 | 2273.7 +- 1.2 | 27.0 +- NaN | +10831.2 +- 596.7 | -98.8 +- NaN | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 19.6 +- 0.7 | 1743.9 +- 1.4 | 20.0 +- NaN | +8797.4 +- 317.5 | -98.9 +- NaN | | 78b-2t1c-ethip6-ip6scale200k-rnd | 24.7 +- 2.2 | 2274.6 +- 2.1 | 26.0 +- NaN | +9108.9 +- 825.3 | -98.9 +- NaN | | 64b-2t1c-eth-l2xcbase | 16.9 +- 0.3 | 1740.1 +- 2.0 | 19.0 +- NaN | +10196.4 +- 193.0 | -98.9 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale2m | 18.2 +- 0.4 | 2272.9 +- 2.0 | 24.0 +- NaN | +12388.5 +- 289.5 | -98.9 +- NaN | | 78b-2t1c-ethip6-ip6scale2m-rnd | 25.0 +- 1.6 | 2275.4 +- 1.3 | 24.0 +- NaN | +9001.6 +- 569.2 | -98.9 +- NaN | | 78b-2t1c-ethip6-ip6scale200k | 21.3 +- 1.3 | 2271.4 +- 1.2 | 23.0 +- NaN | +10563.8 +- 669.6 | -99.0 +- NaN | | 78b-2t1c-ethip6-ip6scale2m | 24.1 +- 2.7 | 2272.0 +- 1.9 | 23.0 +- NaN | +9327.4 +- 1066.5 | -99.0 +- NaN | | 64b-2t1c-eth-l2patch | 15.0 +- 0.0 | 1736.2 +- 1.5 | 17.0 +- NaN | +11474.7 +- 10.3 | -99.0 +- NaN | | 64b-2t1c-avf-eth-l2patch | 14.7 +- 0.5 | 1736.4 +- 2.5 | 17.0 +- NaN | +11712.2 +- 388.5 | -99.0 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale20k | 17.8 +- 0.4 | 2269.7 +- 0.5 | 22.0 +- NaN | +12651.1 +- 302.1 | -99.0 +- NaN | | 78b-2t1c-ethip6-ip6base | 19.3 +- 1.1 | 2269.1 +- 1.9 | 21.0 +- NaN | +11657.0 +- 645.4 | -99.1 +- NaN | | 78b-2t1c-avf-ethip6-ip6base | 16.5 +- 1.3 | 2269.2 +- 1.6 | 21.0 +- NaN | +13652.7 +- 1058.0 | -99.1 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 17.9 +- 0.9 | 2270.1 +- 1.7 | 21.0 +- NaN | +12582.1 +- 620.4 | -99.1 +- NaN | +--------------------------------------------------------------+-------------+---------------+-------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "6" for CSIT rls2101, "7" for CSIT rls2106). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2101.0-7 vs 2101.0-6: Compares CSIT environment current vs previous with previous VPP code. 2106.0-7 vs 2101.0-7: Compares VPP code current vs previous in the current CSIT environment.