+--------------------------------------------------------------+-------------+---------------+-------------+----------------------+----------------------+ | Test Case | 2101.0-6 | 2101.0-7 | 2106.0-7 | 2101.0-7 vs 2101.0-6 | 2106.0-7 vs 2101.0-7 | +--------------------------------------------------------------+-------------+---------------+-------------+----------------------+----------------------+ | 64b-2t1c-avf-ethip4udp-nat44ed-h262144-p63-s16515072-udir | 34.1 +- 2.6 | 1750.2 +- 4.4 | 71.0 +- NaN | +5032.6 +- 391.8 | -95.9 +- NaN | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 35.9 +- 3.4 | 1759.6 +- 1.3 | 54.0 +- NaN | +4801.3 +- 466.1 | -96.9 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44ed-h16384-p63-s1032192-udir | 47.5 +- 8.3 | 1756.7 +- 3.5 | 53.0 +- NaN | +3598.2 +- 649.6 | -97.0 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44ed-h65536-p63-s4128768-udir | 24.1 +- 2.2 | 1763.2 +- 6.9 | 52.0 +- NaN | +7216.3 +- 663.4 | -97.1 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 40.6 +- 4.4 | 1769.3 +- 2.4 | 48.0 +- NaN | +4258.0 +- 475.2 | -97.3 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 41.9 +- 5.1 | 1767.6 +- 3.7 | 47.0 +- NaN | +4118.5 +- 514.4 | -97.3 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir | 27.3 +- 2.5 | 1753.0 +- 3.3 | 45.0 +- NaN | +6321.2 +- 587.4 | -97.4 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 39.6 +- 3.9 | 1763.8 +- 3.0 | 45.0 +- NaN | +4354.0 +- 434.7 | -97.4 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 37.2 +- 3.3 | 1765.3 +- 2.0 | 45.0 +- NaN | +4645.5 +- 415.8 | -97.5 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 40.3 +- 6.6 | 1765.1 +- 5.6 | 44.0 +- NaN | +4279.9 +- 719.3 | -97.5 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 30.0 +- 1.9 | 1758.7 +- 3.5 | 41.0 +- NaN | +5762.2 +- 368.7 | -97.7 +- NaN | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 40.6 +- 4.1 | 1761.4 +- 3.8 | 41.0 +- NaN | +4238.5 +- 434.0 | -97.7 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 41.8 +- 3.0 | 1761.7 +- 5.3 | 40.0 +- NaN | +4114.5 +- 307.6 | -97.7 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 41.3 +- 3.7 | 1762.3 +- 1.8 | 40.0 +- NaN | +4167.2 +- 380.6 | -97.7 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 31.9 +- 6.4 | 1756.7 +- 3.8 | 39.0 +- NaN | +5406.8 +- 1105.3 | -97.8 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 17.1 +- 3.1 | 1741.6 +- 1.6 | 37.0 +- NaN | +10084.5 +- 1871.9 | -97.9 +- NaN | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 35.7 +- 2.7 | 1756.4 +- 1.8 | 36.0 +- NaN | +4820.0 +- 373.5 | -98.0 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h262144-p63-s16515072 | 19.3 +- 8.8 | 1745.1 +- 3.4 | 35.0 +- NaN | +8942.2 +- 4108.5 | -98.0 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 21.5 +- 2.4 | 1740.3 +- 2.7 | 34.0 +- NaN | +7994.6 +- 909.4 | -98.0 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 19.9 +- 3.4 | 1741.1 +- 1.1 | 30.0 +- NaN | +8649.3 +- 1515.3 | -98.3 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 19.8 +- 1.1 | 1743.3 +- 1.2 | 29.0 +- NaN | +8704.7 +- 504.9 | -98.3 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 19.0 +- 0.9 | 1742.0 +- 2.2 | 27.0 +- NaN | +9068.4 +- 455.1 | -98.5 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 18.5 +- 0.8 | 1742.1 +- 2.4 | 27.0 +- NaN | +9316.8 +- 432.8 | -98.5 +- NaN | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 18.9 +- 2.9 | 1742.6 +- 1.8 | 27.0 +- NaN | +9119.9 +- 1407.3 | -98.5 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale2m | 17.2 +- 0.9 | 1739.6 +- 2.2 | 26.0 +- NaN | +10013.7 +- 540.5 | -98.5 +- NaN | | 64b-2t1c-eth-l2bdscale100kmaclrn | 18.7 +- 1.5 | 1740.1 +- 1.3 | 25.0 +- NaN | +9205.4 +- 743.7 | -98.6 +- NaN | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 17.2 +- 0.4 | 1740.4 +- 2.3 | 25.0 +- NaN | +10018.9 +- 248.4 | -98.6 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 17.3 +- 0.8 | 1737.9 +- 0.9 | 23.0 +- NaN | +9945.6 +- 478.1 | -98.7 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 18.3 +- 0.5 | 1740.4 +- 0.9 | 23.0 +- NaN | +9410.6 +- 251.1 | -98.7 +- NaN | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 17.4 +- 0.7 | 1739.8 +- 1.0 | 22.0 +- NaN | +9898.7 +- 401.8 | -98.7 +- NaN | | 64b-2t1c-ethip4-ip4scale2m-rnd | 20.1 +- 1.4 | 1740.1 +- 1.6 | 22.0 +- NaN | +8557.3 +- 590.3 | -98.7 +- NaN | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 18.3 +- 0.9 | 1740.7 +- 1.6 | 22.0 +- NaN | +9394.5 +- 448.6 | -98.7 +- NaN | | 64b-2t1c-eth-l2bdscale1mmaclrn | 20.3 +- 1.3 | 1740.7 +- 1.2 | 22.0 +- NaN | +8474.7 +- 565.0 | -98.7 +- NaN | | 64b-2t1c-eth-l2bdscale10kmaclrn | 18.9 +- 1.4 | 1740.8 +- 2.8 | 22.0 +- NaN | +9110.5 +- 668.0 | -98.7 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 15.5 +- 0.8 | 1738.4 +- 1.4 | 21.0 +- NaN | +11115.8 +- 615.0 | -98.8 +- NaN | | 64b-2t1c-ethip4-ip4scale2m | 18.9 +- 1.4 | 1738.8 +- 1.6 | 21.0 +- NaN | +9099.9 +- 667.1 | -98.8 +- NaN | | 64b-2t1c-ethip4-ip4scale200k-rnd | 18.9 +- 1.0 | 1739.0 +- 2.2 | 21.0 +- NaN | +9101.1 +- 484.3 | -98.8 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 15.9 +- 0.7 | 1740.0 +- 1.1 | 21.0 +- NaN | +10843.4 +- 507.9 | -98.8 +- NaN | | 64b-2t1c-ethip4-ip4base | 17.4 +- 1.2 | 1738.3 +- 1.4 | 20.0 +- NaN | +9890.4 +- 674.0 | -98.8 +- NaN | | 64b-2t1c-ethip4-ip4scale200k | 17.6 +- 1.2 | 1738.3 +- 2.0 | 20.0 +- NaN | +9776.9 +- 658.8 | -98.8 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 16.1 +- 0.6 | 1738.6 +- 1.9 | 20.0 +- NaN | +10698.5 +- 380.9 | -98.8 +- NaN | | 64b-2t1c-ethip4-ip4scale20k | 17.7 +- 0.9 | 1738.6 +- 1.1 | 20.0 +- NaN | +9722.3 +- 526.5 | -98.8 +- NaN | | 64b-2t1c-avf-ethip4-ip4base | 16.0 +- 0.7 | 1738.7 +- 0.7 | 20.0 +- NaN | +10766.7 +- 452.8 | -98.8 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn | 16.9 +- 1.3 | 1738.7 +- 1.9 | 20.0 +- NaN | +10188.0 +- 783.4 | -98.8 +- NaN | | 64b-2t1c-ethip4-ip4scale20k-rnd | 17.9 +- 0.7 | 1738.9 +- 2.0 | 20.0 +- NaN | +9614.5 +- 400.6 | -98.8 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale200k | 16.5 +- 0.7 | 1739.7 +- 1.0 | 20.0 +- NaN | +10443.4 +- 451.9 | -98.9 +- NaN | | 64b-2t1c-avf-eth-l2xcbase | 14.9 +- 0.3 | 1738.1 +- 2.0 | 19.0 +- NaN | +11565.2 +- 247.9 | -98.9 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale20k | 16.3 +- 0.5 | 1738.3 +- 1.9 | 19.0 +- NaN | +10564.6 +- 316.3 | -98.9 +- NaN | | 78b-2t1c-ethip6-ip6scale200k | 20.7 +- 2.1 | 2267.2 +- 2.0 | 24.0 +- NaN | +10852.8 +- 1088.7 | -98.9 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 17.2 +- 1.1 | 2268.4 +- 1.1 | 24.0 +- NaN | +13088.6 +- 870.5 | -98.9 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale2m | 18.0 +- 0.7 | 2270.4 +- 1.6 | 24.0 +- NaN | +12513.6 +- 467.3 | -98.9 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 18.7 +- 6.0 | 2271.4 +- 1.7 | 24.0 +- NaN | +12046.8 +- 3873.8 | -98.9 +- NaN | | 64b-2t1c-eth-l2xcbase | 15.7 +- 0.5 | 1737.8 +- 2.1 | 18.0 +- NaN | +10968.6 +- 340.8 | -99.0 +- NaN | | 78b-2t1c-ethip6-ip6scale2m-rnd | 23.2 +- 1.6 | 2269.3 +- 1.9 | 23.0 +- NaN | +9681.6 +- 682.8 | -99.0 +- NaN | | 64b-2t1c-eth-l2patch | 13.9 +- 0.3 | 1734.8 +- 1.8 | 17.0 +- NaN | +12380.4 +- 284.2 | -99.0 +- NaN | | 78b-2t1c-avf-ethip6-ip6base | 16.6 +- 0.7 | 2266.0 +- 1.7 | 22.0 +- NaN | +13550.6 +- 575.1 | -99.0 +- NaN | | 78b-2t1c-ethip6-ip6scale20k-rnd | 19.0 +- 1.4 | 2266.4 +- 1.3 | 22.0 +- NaN | +11828.7 +- 887.9 | -99.0 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale200k | 17.1 +- 2.0 | 2267.4 +- 1.2 | 22.0 +- NaN | +13159.9 +- 1527.0 | -99.0 +- NaN | | 78b-2t1c-ethip6-ip6scale2m | 21.8 +- 1.6 | 2269.2 +- 1.4 | 22.0 +- NaN | +10309.3 +- 773.2 | -99.0 +- NaN | | 78b-2t1c-ethip6-ip6scale20k | 19.0 +- 0.7 | 2266.2 +- 1.6 | 21.0 +- NaN | +11827.5 +- 418.6 | -99.1 +- NaN | | 78b-2t1c-ethip6-ip6scale200k-rnd | 20.9 +- 1.5 | 2269.7 +- 1.4 | 21.0 +- NaN | +10759.6 +- 791.8 | -99.1 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale20k | 16.8 +- 0.4 | 2267.3 +- 1.1 | 20.0 +- NaN | +13396.0 +- 338.8 | -99.1 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 16.7 +- 0.8 | 2268.7 +- 1.9 | 20.0 +- NaN | +13484.8 +- 669.8 | -99.1 +- NaN | | 64b-2t1c-avf-eth-l2patch | 13.2 +- 0.4 | 1733.8 +- 1.3 | 15.0 +- NaN | +13034.7 +- 419.7 | -99.1 +- NaN | | 78b-2t1c-ethip6-ip6base | 18.2 +- 0.9 | 2267.7 +- 1.1 | 19.0 +- NaN | +12359.7 +- 629.1 | -99.2 +- NaN | +--------------------------------------------------------------+-------------+---------------+-------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "6" for CSIT rls2101, "7" for CSIT rls2106). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2101.0-7 vs 2101.0-6: Compares CSIT environment current vs previous with previous VPP code. 2106.0-7 vs 2101.0-7: Compares VPP code current vs previous in the current CSIT environment.