+-------------------------------------------------------------------+------------------+------------------+---------------+----------------------+----------------------+ | Test Case | 2101.0-6 | 2101.0-7 | 2106.0-7 | 2101.0-7 vs 2101.0-6 | 2106.0-7 vs 2101.0-7 | +-------------------------------------------------------------------+------------------+------------------+---------------+----------------------+----------------------+ | 78b-1t1c-ethip6-ip6scale2m | 316.0 +- 18.2 | 316.0 +- 18.2 | 6096.0 +- NaN | +0.0 +- 8.1 | +1829.1 +- NaN | | 64b-1t1c-eth-l2patch | 140.3 +- 20.1 | 140.3 +- 20.1 | 1170.0 +- NaN | +0.0 +- 20.3 | +733.9 +- NaN | | 78b-1t1c-ethip6-ip6scale20k | 223.6 +- 62.8 | 223.6 +- 62.8 | 1041.0 +- NaN | +0.0 +- 39.7 | +365.5 +- NaN | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 407.2 +- 659.7 | 407.2 +- 659.7 | 1466.0 +- NaN | +0.0 +- 229.1 | +260.0 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 408.5 +- 635.2 | 408.5 +- 635.2 | 1005.0 +- NaN | +0.0 +- 219.9 | +146.0 +- NaN | | 78b-1t1c-ethip6srhip6-ip6base-srv6enc2sids | 510.3 +- 634.2 | 510.3 +- 634.2 | 1178.0 +- NaN | +0.0 +- 175.7 | +130.8 +- NaN | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 184.7 +- 24.0 | 184.7 +- 24.0 | 410.0 +- NaN | +0.0 +- 18.4 | +122.0 +- NaN | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 181.2 +- 22.4 | 181.2 +- 22.4 | 345.0 +- NaN | +0.0 +- 17.5 | +90.4 +- NaN | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 1019.9 +- 171.5 | 1019.9 +- 171.5 | 1663.0 +- NaN | +0.0 +- 23.8 | +63.1 +- NaN | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 1198.6 +- 247.4 | 1198.6 +- 247.4 | 1861.0 +- NaN | +0.0 +- 29.2 | +55.3 +- NaN | | 78b-1t1c-ethip6-ip6scale200k | 713.1 +- 872.0 | 713.1 +- 872.0 | 966.0 +- NaN | +0.0 +- 172.9 | +35.5 +- NaN | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 1584.7 +- 1292.1 | 1584.7 +- 1292.1 | 2119.0 +- NaN | +0.0 +- 115.3 | +33.7 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 595.1 +- 90.5 | 595.1 +- 90.5 | 794.0 +- NaN | +0.0 +- 21.5 | +33.4 +- NaN | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm | 1673.3 +- 940.1 | 1673.3 +- 940.1 | 2177.0 +- NaN | +0.0 +- 79.5 | +30.1 +- NaN | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 1621.3 +- 1308.8 | 1621.3 +- 1308.8 | 1986.0 +- NaN | +0.0 +- 114.2 | +22.5 +- NaN | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm-vppip4 | 670.4 +- 64.8 | 670.4 +- 64.8 | 813.0 +- NaN | +0.0 +- 13.7 | +21.3 +- NaN | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 664.0 +- 38.7 | 664.0 +- 38.7 | 685.0 +- NaN | +0.0 +- 8.2 | +3.2 +- NaN | | 64b-1t1c-eth-l2bdscale10kmaclrn | 1047.1 +- 1034.9 | 1047.1 +- 1034.9 | 1059.0 +- NaN | +0.0 +- 139.8 | +1.1 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 384.8 +- 618.8 | 384.8 +- 618.8 | 377.0 +- NaN | +0.0 +- 227.4 | -2.0 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2memif-1lxc | 1126.6 +- 690.8 | 1126.6 +- 690.8 | 1062.0 +- NaN | +0.0 +- 86.7 | -5.7 +- NaN | | 64b-1t1c-eth-l2xcbase-eth-2memif-1dcr | 1014.7 +- 606.7 | 1014.7 +- 606.7 | 938.0 +- NaN | +0.0 +- 84.6 | -7.6 +- NaN | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 428.2 +- 714.4 | 428.2 +- 714.4 | 373.0 +- NaN | +0.0 +- 235.9 | -12.9 +- NaN | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 1171.6 +- 888.7 | 1171.6 +- 888.7 | 993.0 +- NaN | +0.0 +- 107.3 | -15.2 +- NaN | | 64b-1t1c-ethip4-ip4scale2m | 244.0 +- 29.5 | 244.0 +- 29.5 | 201.0 +- NaN | +0.0 +- 17.1 | -17.6 +- NaN | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 1301.7 +- 797.7 | 1301.7 +- 797.7 | 1041.0 +- NaN | +0.0 +- 86.7 | -20.0 +- NaN | | 64b-1t1c-ethip4-ip4base | 621.0 +- 851.0 | 621.0 +- 851.0 | 460.0 +- NaN | +0.0 +- 193.8 | -25.9 +- NaN | | 64b-1t1c-eth-l2bdscale1mmaclrn | 941.7 +- 723.6 | 941.7 +- 723.6 | 680.0 +- NaN | +0.0 +- 108.7 | -27.8 +- NaN | | 64b-1t1c-dot1q-l2bdbasemaclrn | 445.0 +- 626.4 | 445.0 +- 626.4 | 304.0 +- NaN | +0.0 +- 199.1 | -31.7 +- NaN | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 2129.2 +- 868.0 | 2129.2 +- 868.0 | 1404.0 +- NaN | +0.0 +- 57.7 | -34.1 +- NaN | | 64b-1t1c-ethip4vxlan-l2xcbase | 543.1 +- 712.7 | 543.1 +- 712.7 | 344.0 +- NaN | +0.0 +- 185.6 | -36.7 +- NaN | | 78b-1t1c-ethip6ip6-ip6base-srv6enc1sid | 493.7 +- 689.5 | 493.7 +- 689.5 | 311.0 +- NaN | +0.0 +- 197.5 | -37.0 +- NaN | | 64b-1t1c-ethip4-ip4base-eth-2memif-1dcr | 1637.9 +- 1066.3 | 1637.9 +- 1066.3 | 965.0 +- NaN | +0.0 +- 92.1 | -41.1 +- NaN | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 763.3 +- 878.8 | 763.3 +- 878.8 | 439.0 +- NaN | +0.0 +- 162.8 | -42.5 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 789.4 +- 1136.4 | 789.4 +- 1136.4 | 393.0 +- NaN | +0.0 +- 203.6 | -50.2 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn | 429.2 +- 663.2 | 429.2 +- 663.2 | 206.0 +- NaN | +0.0 +- 218.5 | -52.0 +- NaN | | 64b-1t1c-ethip4-ip4scale200k | 456.3 +- 674.9 | 456.3 +- 674.9 | 207.0 +- NaN | +0.0 +- 209.2 | -54.6 +- NaN | | 78b-1t1c-ethip6-ip6base | 429.9 +- 648.8 | 429.9 +- 648.8 | 192.0 +- NaN | +0.0 +- 213.4 | -55.3 +- NaN | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 2057.2 +- 1684.3 | 2057.2 +- 1684.3 | 903.0 +- NaN | +0.0 +- 115.8 | -56.1 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 455.0 +- 655.8 | 455.0 +- 655.8 | 187.0 +- NaN | +0.0 +- 203.8 | -58.9 +- NaN | | 64b-1t1c-eth-l2bdscale100kmaclrn | 713.1 +- 825.0 | 713.1 +- 825.0 | 285.0 +- NaN | +0.0 +- 163.6 | -60.0 +- NaN | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 1295.3 +- 1106.5 | 1295.3 +- 1106.5 | 466.0 +- NaN | +0.0 +- 120.8 | -64.0 +- NaN | | 64b-1t1c-ethip4-ip4scale20k | 618.2 +- 842.8 | 618.2 +- 842.8 | 196.0 +- NaN | +0.0 +- 192.8 | -68.3 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 868.6 +- 1114.1 | 868.6 +- 1114.1 | 167.0 +- NaN | +0.0 +- 181.4 | -80.8 +- NaN | | 78b-1t1c-ethip6srhip6-ip6base-srv6enc2sids-nodecaps | 498.2 +- 670.6 | 498.2 +- 670.6 | 0.0 +- NaN | +0.0 +- 190.3 | -100.0 +- NaN | | 78b-1t1c-ethip6srhip6-ip6base-srv6proxy-dyn | 703.7 +- 481.7 | 703.7 +- 481.7 | 0.0 +- NaN | +0.0 +- 96.8 | -100.0 +- NaN | | 78b-1t1c-ethip6srhip6-ip6base-srv6proxy-masq | 779.7 +- 739.4 | 779.7 +- 739.4 | 0.0 +- NaN | +0.0 +- 134.1 | -100.0 +- NaN | +-------------------------------------------------------------------+------------------+------------------+---------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "6" for CSIT rls2101, "7" for CSIT rls2106). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2101.0-7 vs 2101.0-6: Compares CSIT environment current vs previous with previous VPP code. 2106.0-7 vs 2101.0-7: Compares VPP code current vs previous in the current CSIT environment.