+--------------------------------------------------------------+---------------+----------------+--------------+----------------------+----------------------+ | Test Case | 2101.0-6 | 2101.0-7 | 2106.0-7 | 2101.0-7 vs 2101.0-6 | 2106.0-7 vs 2101.0-7 | +--------------------------------------------------------------+---------------+----------------+--------------+----------------------+----------------------+ | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 101.7 +- 3.3 | 1890.1 +- 25.9 | 285.0 +- NaN | +1758.5 +- 65.5 | -84.9 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 120.7 +- 13.0 | 1882.7 +- 3.0 | 236.0 +- NaN | +1459.8 +- 168.5 | -87.5 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 104.4 +- 1.7 | 1906.6 +- 9.8 | 234.0 +- NaN | +1726.2 +- 31.4 | -87.7 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 82.1 +- 3.6 | 1850.4 +- 7.1 | 204.0 +- NaN | +2153.9 +- 99.3 | -89.0 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 90.2 +- 3.8 | 1888.3 +- 3.0 | 188.0 +- NaN | +1993.5 +- 87.5 | -90.0 +- NaN | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 122.5 +- 17.9 | 1877.6 +- 3.0 | 182.0 +- NaN | +1432.7 +- 223.5 | -90.3 +- NaN | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 94.2 +- 4.0 | 1870.3 +- 9.4 | 160.0 +- NaN | +1885.5 +- 84.2 | -91.4 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 81.9 +- 1.3 | 1877.0 +- 3.8 | 160.0 +- NaN | +2191.8 +- 36.3 | -91.5 +- NaN | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 101.0 +- 3.6 | 1860.6 +- 3.5 | 156.0 +- NaN | +1742.1 +- 65.0 | -91.6 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 82.9 +- 2.1 | 1842.4 +- 2.8 | 122.0 +- NaN | +2122.5 +- 55.8 | -93.4 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 66.1 +- 1.3 | 1828.2 +- 7.7 | 115.0 +- NaN | +2665.8 +- 55.1 | -93.7 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 74.9 +- 2.0 | 1802.1 +- 28.1 | 96.0 +- NaN | +2306.0 +- 73.6 | -94.7 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44ed-h65536-p63-s4128768-udir | 69.1 +- 3.8 | 1796.0 +- 6.9 | 77.0 +- NaN | +2499.1 +- 143.8 | -95.7 +- NaN | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 28.8 +- 2.3 | 1762.1 +- 3.5 | 71.0 +- NaN | +6018.4 +- 478.4 | -96.0 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44ed-h16384-p63-s1032192-udir | 66.4 +- 5.3 | 1788.0 +- 7.0 | 70.0 +- NaN | +2592.8 +- 215.9 | -96.1 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir | 61.7 +- 2.4 | 1780.8 +- 3.1 | 67.0 +- NaN | +2786.2 +- 110.5 | -96.2 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h262144-p63-s16515072 | 36.4 +- 2.5 | 1765.6 +- 2.6 | 64.0 +- NaN | +4750.5 +- 333.7 | -96.4 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44ed-h262144-p63-s16515072-udir | 71.4 +- 2.1 | 1791.6 +- 5.4 | 64.0 +- NaN | +2409.2 +- 73.0 | -96.4 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 33.6 +- 2.0 | 1762.0 +- 3.5 | 59.0 +- NaN | +5144.0 +- 305.3 | -96.7 +- NaN | | 64b-2t1c-eth-l2bdscale10kmaclrn | 37.5 +- 2.4 | 1782.4 +- 5.5 | 59.0 +- NaN | +4653.2 +- 300.6 | -96.7 +- NaN | | 64b-2t1c-eth-l2bdscale1mmaclrn | 39.3 +- 5.6 | 1773.9 +- 4.0 | 55.0 +- NaN | +4413.7 +- 640.8 | -96.9 +- NaN | | 64b-2t1c-ethip4-ip4scale200k-rnd | 32.3 +- 1.3 | 1765.7 +- 3.8 | 52.0 +- NaN | +5366.5 +- 226.7 | -97.1 +- NaN | | 64b-2t1c-eth-l2bdscale100kmaclrn | 36.3 +- 4.5 | 1769.1 +- 3.2 | 52.0 +- NaN | +4773.6 +- 607.3 | -97.1 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 40.3 +- 0.8 | 1774.9 +- 3.3 | 51.0 +- NaN | +4304.2 +- 90.3 | -97.1 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 38.9 +- 0.6 | 1768.6 +- 1.7 | 50.0 +- NaN | +4446.4 +- 66.5 | -97.2 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 41.8 +- 0.8 | 1773.8 +- 2.6 | 50.0 +- NaN | +4143.5 +- 80.3 | -97.2 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 38.3 +- 1.8 | 1767.1 +- 1.7 | 49.0 +- NaN | +4513.9 +- 212.9 | -97.2 +- NaN | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 35.7 +- 1.8 | 1768.7 +- 1.9 | 49.0 +- NaN | +4854.2 +- 253.8 | -97.2 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale2m | 29.8 +- 0.8 | 1766.0 +- 5.0 | 48.0 +- NaN | +5826.2 +- 157.8 | -97.3 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale20k | 27.8 +- 0.9 | 1761.3 +- 1.9 | 47.0 +- NaN | +6235.7 +- 209.5 | -97.3 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn | 33.0 +- 0.7 | 1762.3 +- 6.6 | 47.0 +- NaN | +5240.4 +- 109.7 | -97.3 +- NaN | | 64b-2t1c-ethip4-ip4scale2m | 33.7 +- 1.3 | 1762.9 +- 4.1 | 46.0 +- NaN | +5131.1 +- 208.0 | -97.4 +- NaN | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 35.9 +- 2.4 | 1768.9 +- 1.6 | 46.0 +- NaN | +4828.8 +- 332.5 | -97.4 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 45.1 +- 6.6 | 1758.3 +- 2.6 | 45.0 +- NaN | +3798.7 +- 568.3 | -97.4 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale200k | 28.4 +- 0.8 | 1761.8 +- 4.1 | 45.0 +- NaN | +6103.4 +- 184.8 | -97.4 +- NaN | | 64b-2t1c-ethip4-ip4scale20k-rnd | 31.2 +- 1.3 | 1760.7 +- 2.8 | 43.0 +- NaN | +5543.2 +- 238.3 | -97.6 +- NaN | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 33.2 +- 0.6 | 1765.3 +- 1.1 | 43.0 +- NaN | +5217.3 +- 101.3 | -97.6 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 34.1 +- 1.8 | 2299.7 +- 2.3 | 56.0 +- NaN | +6643.9 +- 354.5 | -97.6 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 41.3 +- 1.3 | 1759.3 +- 2.3 | 41.0 +- NaN | +4159.9 +- 138.1 | -97.7 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 27.4 +- 0.8 | 1761.6 +- 6.1 | 41.0 +- NaN | +6329.0 +- 199.1 | -97.7 +- NaN | | 64b-2t1c-ethip4-ip4scale2m-rnd | 31.7 +- 1.5 | 1762.4 +- 3.5 | 41.0 +- NaN | +5459.8 +- 262.3 | -97.7 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 29.3 +- 1.6 | 1762.8 +- 1.1 | 41.0 +- NaN | +5916.3 +- 321.8 | -97.7 +- NaN | | 64b-2t1c-ethip4-ip4scale200k | 31.3 +- 1.3 | 1758.4 +- 3.2 | 40.0 +- NaN | +5518.0 +- 240.3 | -97.7 +- NaN | | 64b-2t1c-ethip4-ip4base | 28.5 +- 0.8 | 1766.7 +- 6.2 | 40.0 +- NaN | +6098.8 +- 186.1 | -97.7 +- NaN | | 64b-2t1c-avf-ethip4-ip4base | 28.5 +- 1.4 | 1758.0 +- 1.3 | 39.0 +- NaN | +6068.4 +- 310.3 | -97.8 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 25.5 +- 0.5 | 1759.4 +- 1.7 | 39.0 +- NaN | +6799.8 +- 142.8 | -97.8 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 27.0 +- 1.1 | 1761.6 +- 2.2 | 39.0 +- NaN | +6424.3 +- 254.8 | -97.8 +- NaN | | 78b-2t1c-ethip6-ip6scale200k-rnd | 33.8 +- 4.2 | 2298.6 +- 2.8 | 50.0 +- NaN | +6700.5 +- 842.0 | -97.8 +- NaN | | 64b-2t1c-eth-l2xcbase | 25.5 +- 0.5 | 1757.4 +- 2.8 | 38.0 +- NaN | +6791.9 +- 142.9 | -97.8 +- NaN | | 64b-2t1c-ethip4-ip4scale20k | 30.8 +- 1.2 | 1755.3 +- 1.2 | 37.0 +- NaN | +5599.1 +- 227.5 | -97.9 +- NaN | | 78b-2t1c-ethip6-ip6scale2m-rnd | 39.6 +- 1.4 | 2298.2 +- 3.1 | 48.0 +- NaN | +5703.6 +- 209.7 | -97.9 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 31.8 +- 2.5 | 2294.3 +- 2.2 | 45.0 +- NaN | +7114.9 +- 574.0 | -98.0 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale2m | 33.0 +- 2.6 | 2291.0 +- 3.5 | 44.0 +- NaN | +6842.4 +- 552.3 | -98.1 +- NaN | | 78b-2t1c-ethip6-ip6scale200k | 32.7 +- 2.6 | 2288.2 +- 1.5 | 42.0 +- NaN | +6897.6 +- 553.0 | -98.2 +- NaN | | 78b-2t1c-ethip6-ip6base | 27.0 +- 0.5 | 2286.0 +- 1.4 | 41.0 +- NaN | +8366.7 +- 147.9 | -98.2 +- NaN | | 78b-2t1c-ethip6-ip6scale20k-rnd | 30.3 +- 1.3 | 2289.2 +- 3.7 | 41.0 +- NaN | +7455.2 +- 312.3 | -98.2 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale200k | 30.3 +- 1.3 | 2292.0 +- 4.6 | 41.0 +- NaN | +7464.4 +- 334.2 | -98.2 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 30.9 +- 1.3 | 2293.2 +- 1.5 | 41.0 +- NaN | +7321.4 +- 309.1 | -98.2 +- NaN | | 64b-2t1c-avf-eth-l2xcbase | 23.8 +- 0.8 | 1754.9 +- 3.4 | 31.0 +- NaN | +7273.5 +- 244.8 | -98.2 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale20k | 30.3 +- 0.8 | 2287.4 +- 1.2 | 38.0 +- NaN | +7449.3 +- 205.2 | -98.3 +- NaN | | 78b-2t1c-avf-ethip6-ip6base | 26.3 +- 0.5 | 2288.4 +- 1.3 | 38.0 +- NaN | +8601.3 +- 159.9 | -98.3 +- NaN | | 78b-2t1c-ethip6-ip6scale20k | 31.3 +- 1.2 | 2283.7 +- 2.4 | 36.0 +- NaN | +7196.1 +- 270.4 | -98.4 +- NaN | | 64b-2t1c-eth-l2patch | 22.3 +- 0.7 | 1749.3 +- 1.9 | 27.0 +- NaN | +7744.5 +- 237.6 | -98.5 +- NaN | | 78b-2t1c-ethip6-ip6scale2m | 31.6 +- 1.1 | 2287.6 +- 3.4 | 35.0 +- NaN | +7139.1 +- 246.5 | -98.5 +- NaN | | 64b-2t1c-avf-eth-l2patch | 15.8 +- 0.4 | 1738.4 +- 0.9 | 20.0 +- NaN | +10902.8 +- 293.7 | -98.8 +- NaN | +--------------------------------------------------------------+---------------+----------------+--------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "6" for CSIT rls2101, "7" for CSIT rls2106). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2101.0-7 vs 2101.0-6: Compares CSIT environment current vs previous with previous VPP code. 2106.0-7 vs 2101.0-7: Compares VPP code current vs previous in the current CSIT environment.