+--------------------------------------------------------------+---------------+----------------+--------------+----------------------+----------------------+ | Test Case | 2101.0-6 | 2101.0-7 | 2106.0-7 | 2101.0-7 vs 2101.0-6 | 2106.0-7 vs 2101.0-7 | +--------------------------------------------------------------+---------------+----------------+--------------+----------------------+----------------------+ | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 157.8 +- 5.5 | 2042.9 +- 30.3 | 271.0 +- NaN | +1194.6 +- 49.3 | -86.7 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 97.6 +- 3.3 | 1938.5 +- 11.3 | 225.0 +- NaN | +1886.2 +- 68.9 | -88.4 +- NaN | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 88.3 +- 1.6 | 1894.0 +- 5.4 | 218.0 +- NaN | +2045.0 +- 38.6 | -88.5 +- NaN | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 91.3 +- 1.7 | 1912.4 +- 6.4 | 207.0 +- NaN | +1994.6 +- 39.7 | -89.2 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 84.7 +- 1.6 | 1903.4 +- 6.6 | 184.0 +- NaN | +2147.2 +- 42.3 | -90.3 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 77.0 +- 0.8 | 1881.7 +- 8.6 | 176.0 +- NaN | +2343.8 +- 28.2 | -90.6 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 83.1 +- 1.7 | 1884.4 +- 2.0 | 173.0 +- NaN | +2167.6 +- 45.5 | -90.8 +- NaN | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 78.2 +- 0.8 | 1878.5 +- 3.4 | 168.0 +- NaN | +2302.2 +- 24.6 | -91.1 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 95.5 +- 8.3 | 1875.0 +- 4.1 | 156.0 +- NaN | +1863.4 +- 170.8 | -91.7 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 129.4 +- 8.3 | 1861.4 +- 8.5 | 129.0 +- NaN | +1338.5 +- 92.5 | -93.1 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 83.9 +- 3.4 | 1826.3 +- 1.8 | 111.0 +- NaN | +2076.8 +- 89.4 | -93.9 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 79.8 +- 1.6 | 1827.5 +- 3.0 | 105.0 +- NaN | +2190.1 +- 46.6 | -94.3 +- NaN | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 43.0 +- 6.6 | 1782.6 +- 5.0 | 81.0 +- NaN | +4045.6 +- 636.4 | -95.5 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h262144-p63-s16515072 | 29.0 +- 1.4 | 1785.2 +- 10.4 | 75.0 +- NaN | +6055.9 +- 302.3 | -95.8 +- NaN | | 64b-2t1c-ethip4-ip4scale2m-rnd | 37.3 +- 3.0 | 1773.1 +- 2.0 | 70.0 +- NaN | +4653.6 +- 385.0 | -96.1 +- NaN | | 64b-2t1c-ethip4-ip4base | 26.8 +- 0.6 | 1767.1 +- 7.8 | 69.0 +- NaN | +6493.7 +- 158.3 | -96.1 +- NaN | | 64b-2t1c-eth-l2bdscale1mmaclrn | 75.8 +- 12.8 | 1786.6 +- 3.4 | 68.0 +- NaN | +2257.0 +- 398.7 | -96.2 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 34.3 +- 2.2 | 1780.5 +- 3.4 | 63.0 +- NaN | +5091.0 +- 335.2 | -96.5 +- NaN | | 64b-2t1c-eth-l2bdscale100kmaclrn | 51.3 +- 3.9 | 1780.8 +- 4.8 | 63.0 +- NaN | +3371.3 +- 263.3 | -96.5 +- NaN | | 64b-2t1c-ethip4-ip4scale200k-rnd | 28.8 +- 0.8 | 1769.3 +- 3.4 | 61.0 +- NaN | +6043.4 +- 168.7 | -96.6 +- NaN | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 31.4 +- 0.7 | 1773.5 +- 3.5 | 60.0 +- NaN | +5548.1 +- 126.3 | -96.6 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 35.2 +- 0.8 | 1778.5 +- 3.6 | 59.0 +- NaN | +4952.6 +- 113.7 | -96.7 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale200k | 31.7 +- 1.1 | 2308.7 +- 6.3 | 76.0 +- NaN | +7183.0 +- 244.2 | -96.7 +- NaN | | 64b-2t1c-ethip4-ip4scale20k-rnd | 27.9 +- 0.6 | 1767.6 +- 2.5 | 57.0 +- NaN | +6235.5 +- 129.2 | -96.8 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale200k | 30.0 +- 0.0 | 1768.7 +- 2.5 | 56.0 +- NaN | +5795.7 +- 8.3 | -96.8 +- NaN | | 78b-2t1c-ethip6-ip6scale200k | 34.1 +- 1.3 | 2293.9 +- 2.5 | 72.0 +- NaN | +6627.0 +- 253.9 | -96.9 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale2m | 31.2 +- 0.6 | 1768.7 +- 3.2 | 55.0 +- NaN | +5568.9 +- 115.4 | -96.9 +- NaN | | 64b-2t1c-ethip4-ip4scale20k | 27.9 +- 0.6 | 1768.5 +- 2.2 | 53.0 +- NaN | +6238.7 +- 129.2 | -97.0 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 48.0 +- 2.2 | 1771.6 +- 2.5 | 53.0 +- NaN | +3590.8 +- 166.2 | -97.0 +- NaN | | 64b-2t1c-eth-l2bdscale10kmaclrn | 28.2 +- 0.4 | 1766.6 +- 1.3 | 52.0 +- NaN | +6164.5 +- 93.8 | -97.1 +- NaN | | 78b-2t1c-ethip6-ip6scale2m-rnd | 41.2 +- 1.9 | 2311.5 +- 2.5 | 68.0 +- NaN | +5510.4 +- 263.2 | -97.1 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 35.7 +- 0.5 | 1771.9 +- 2.0 | 52.0 +- NaN | +4863.3 +- 67.4 | -97.1 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 34.6 +- 0.5 | 1777.7 +- 4.6 | 52.0 +- NaN | +5037.9 +- 77.8 | -97.1 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale20k | 28.1 +- 0.3 | 1763.9 +- 2.8 | 51.0 +- NaN | +6177.2 +- 71.3 | -97.1 +- NaN | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 29.1 +- 0.6 | 1765.0 +- 3.5 | 51.0 +- NaN | +5965.3 +- 118.9 | -97.1 +- NaN | | 64b-2t1c-ethip4-ip4scale200k | 29.5 +- 0.7 | 1768.5 +- 3.4 | 51.0 +- NaN | +5894.9 +- 144.2 | -97.1 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 33.9 +- 2.2 | 1771.9 +- 2.3 | 51.0 +- NaN | +5126.8 +- 344.5 | -97.1 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale2m | 31.2 +- 0.8 | 2306.5 +- 2.4 | 66.0 +- NaN | +7292.6 +- 187.1 | -97.1 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 28.2 +- 0.4 | 1761.9 +- 3.9 | 50.0 +- NaN | +6147.9 +- 94.4 | -97.2 +- NaN | | 64b-2t1c-ethip4-ip4scale2m | 29.8 +- 1.4 | 1767.8 +- 1.3 | 50.0 +- NaN | +5832.2 +- 278.4 | -97.2 +- NaN | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 31.4 +- 0.5 | 1768.7 +- 1.9 | 50.0 +- NaN | +5532.8 +- 92.8 | -97.2 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 33.6 +- 0.7 | 1774.7 +- 1.9 | 50.0 +- NaN | +5181.8 +- 110.1 | -97.2 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 41.4 +- 0.7 | 1760.1 +- 3.0 | 49.0 +- NaN | +4151.4 +- 72.2 | -97.2 +- NaN | | 78b-2t1c-ethip6-ip6scale20k-rnd | 37.4 +- 1.1 | 2310.0 +- 2.4 | 63.0 +- NaN | +6076.5 +- 177.6 | -97.3 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 39.5 +- 1.3 | 2310.1 +- 0.9 | 63.0 +- NaN | +5748.4 +- 187.9 | -97.3 +- NaN | | 78b-2t1c-ethip6-ip6scale200k-rnd | 38.6 +- 1.6 | 2312.0 +- 2.3 | 63.0 +- NaN | +5889.6 +- 244.9 | -97.3 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn | 26.3 +- 0.5 | 1762.0 +- 2.1 | 48.0 +- NaN | +6599.6 +- 123.3 | -97.3 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 29.8 +- 0.4 | 1764.7 +- 2.5 | 48.0 +- NaN | +5821.8 +- 84.2 | -97.3 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 40.8 +- 0.9 | 2311.2 +- 1.7 | 62.0 +- NaN | +5564.7 +- 127.7 | -97.3 +- NaN | | 78b-2t1c-ethip6-ip6scale2m | 33.8 +- 1.4 | 2293.0 +- 2.7 | 61.0 +- NaN | +6684.0 +- 280.8 | -97.3 +- NaN | | 64b-2t1c-avf-ethip4-ip4base | 28.7 +- 0.5 | 1761.6 +- 2.6 | 46.0 +- NaN | +6038.0 +- 103.7 | -97.4 +- NaN | | 78b-2t1c-ethip6-ip6scale20k | 36.9 +- 1.0 | 2302.1 +- 2.3 | 58.0 +- NaN | +6138.8 +- 168.2 | -97.5 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 28.2 +- 0.4 | 1760.9 +- 2.6 | 44.0 +- NaN | +6144.3 +- 93.8 | -97.5 +- NaN | | 64b-2t1c-avf-eth-l2xcbase | 26.8 +- 0.6 | 1754.8 +- 1.2 | 43.0 +- NaN | +6447.8 +- 154.6 | -97.5 +- NaN | | 64b-2t1c-eth-l2xcbase | 24.1 +- 0.3 | 1757.3 +- 1.6 | 41.0 +- NaN | +7191.7 +- 95.9 | -97.7 +- NaN | | 78b-2t1c-avf-ethip6-ip6base | 30.0 +- 1.2 | 2292.2 +- 1.9 | 53.0 +- NaN | +7540.7 +- 294.2 | -97.7 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale20k | 29.6 +- 0.5 | 2295.5 +- 2.6 | 50.0 +- NaN | +7655.1 +- 135.6 | -97.8 +- NaN | | 78b-2t1c-ethip6-ip6base | 27.2 +- 0.6 | 2292.0 +- 1.6 | 48.0 +- NaN | +8326.5 +- 196.0 | -97.9 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 30.5 +- 0.7 | 2293.9 +- 1.0 | 46.0 +- NaN | +7421.0 +- 174.4 | -98.0 +- NaN | | 64b-2t1c-eth-l2patch | 22.2 +- 0.6 | 1749.8 +- 2.5 | 31.0 +- NaN | +7782.0 +- 224.8 | -98.2 +- NaN | | 64b-2t1c-avf-eth-l2patch | 17.1 +- 0.3 | 1743.9 +- 1.2 | 22.0 +- NaN | +10098.2 +- 188.7 | -98.7 +- NaN | +--------------------------------------------------------------+---------------+----------------+--------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "6" for CSIT rls2101, "7" for CSIT rls2106). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2101.0-7 vs 2101.0-6: Compares CSIT environment current vs previous with previous VPP code. 2106.0-7 vs 2101.0-7: Compares VPP code current vs previous in the current CSIT environment.