+-------------------------------------------------------------------+---------------+---------------+--------------+----------------------+----------------------+ | Test Case | 2101.0-6 | 2101.0-7 | 2106.0-7 | 2101.0-7 vs 2101.0-6 | 2106.0-7 vs 2101.0-7 | +-------------------------------------------------------------------+---------------+---------------+--------------+----------------------+----------------------+ | 64b-1t1c-ethip4-ip4scale200k | 49.4 +- 14.1 | 49.4 +- 14.1 | 80.0 +- NaN | +0.0 +- 40.4 | +61.8 +- NaN | | 64b-1t1c-eth-l2bdscale10kmaclrn | 58.5 +- 12.8 | 58.5 +- 12.8 | 83.0 +- NaN | +0.0 +- 31.0 | +41.9 +- NaN | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm | 174.9 +- 25.4 | 174.9 +- 25.4 | 240.0 +- NaN | +0.0 +- 20.6 | +37.2 +- NaN | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 205.2 +- 21.7 | 205.2 +- 21.7 | 249.0 +- NaN | +0.0 +- 14.9 | +21.3 +- NaN | | 64b-1t1c-eth-l2bdscale1mmaclrn | 67.5 +- 8.0 | 67.5 +- 8.0 | 77.0 +- NaN | +0.0 +- 16.8 | +14.1 +- NaN | | 64b-1t1c-dot1q-l2bdbasemaclrn | 55.9 +- 14.5 | 55.9 +- 14.5 | 59.0 +- NaN | +0.0 +- 36.7 | +5.5 +- NaN | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm-vppip4 | 152.7 +- 16.4 | 152.7 +- 16.4 | 158.0 +- NaN | +0.0 +- 15.2 | +3.5 +- NaN | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 52.7 +- 3.2 | 52.7 +- 3.2 | 54.0 +- NaN | +0.0 +- 8.6 | +2.5 +- NaN | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 53.9 +- 3.5 | 53.9 +- 3.5 | 55.0 +- NaN | +0.0 +- 9.1 | +2.1 +- NaN | | 64b-1t1c-ethip4-ip4base | 55.0 +- 4.9 | 55.0 +- 4.9 | 56.0 +- NaN | +0.0 +- 12.7 | +1.8 +- NaN | | 78b-1t1c-ethip6-ip6scale2m | 74.1 +- 14.5 | 74.1 +- 14.5 | 75.0 +- NaN | +0.0 +- 27.7 | +1.2 +- NaN | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 183.7 +- 15.8 | 183.7 +- 15.8 | 182.0 +- NaN | +0.0 +- 12.1 | -0.9 +- NaN | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 150.9 +- 32.2 | 150.9 +- 32.2 | 148.0 +- NaN | +0.0 +- 30.2 | -1.9 +- NaN | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 166.4 +- 14.2 | 166.4 +- 14.2 | 161.0 +- NaN | +0.0 +- 12.1 | -3.2 +- NaN | | 64b-1t1c-eth-l2xcbase-eth-2memif-1dcr | 112.9 +- 7.0 | 112.9 +- 7.0 | 109.0 +- NaN | +0.0 +- 8.7 | -3.5 +- NaN | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 138.1 +- 20.8 | 138.1 +- 20.8 | 133.0 +- NaN | +0.0 +- 21.3 | -3.7 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn | 56.8 +- 5.4 | 56.8 +- 5.4 | 54.0 +- NaN | +0.0 +- 13.4 | -4.9 +- NaN | | 64b-1t1c-eth-l2bdscale100kmaclrn | 65.8 +- 2.6 | 65.8 +- 2.6 | 62.0 +- NaN | +0.0 +- 5.5 | -5.8 +- NaN | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 219.5 +- 11.6 | 219.5 +- 11.6 | 206.0 +- NaN | +0.0 +- 7.5 | -6.2 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 54.4 +- 2.8 | 54.4 +- 2.8 | 51.0 +- NaN | +0.0 +- 7.2 | -6.2 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 52.6 +- 3.4 | 52.6 +- 3.4 | 49.0 +- NaN | +0.0 +- 9.2 | -6.8 +- NaN | | 78b-1t1c-ethip6-ip6scale20k | 58.4 +- 8.2 | 58.4 +- 8.2 | 54.0 +- NaN | +0.0 +- 19.9 | -7.5 +- NaN | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 89.3 +- 6.4 | 89.3 +- 6.4 | 81.0 +- NaN | +0.0 +- 10.2 | -9.3 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2memif-1lxc | 141.6 +- 7.7 | 141.6 +- 7.7 | 128.0 +- NaN | +0.0 +- 7.7 | -9.6 +- NaN | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 184.4 +- 10.4 | 184.4 +- 10.4 | 166.0 +- NaN | +0.0 +- 7.9 | -10.0 +- NaN | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 54.6 +- 3.4 | 54.6 +- 3.4 | 49.0 +- NaN | +0.0 +- 8.9 | -10.2 +- NaN | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 52.7 +- 4.9 | 52.7 +- 4.9 | 47.0 +- NaN | +0.0 +- 13.3 | -10.8 +- NaN | | 64b-1t1c-ethip4vxlan-l2xcbase | 75.5 +- 5.7 | 75.5 +- 5.7 | 67.0 +- NaN | +0.0 +- 10.6 | -11.3 +- NaN | | 78b-1t1c-ethip6srhip6-ip6base-srv6enc2sids | 78.9 +- 5.9 | 78.9 +- 5.9 | 70.0 +- NaN | +0.0 +- 10.5 | -11.3 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 52.6 +- 2.4 | 52.6 +- 2.4 | 46.0 +- NaN | +0.0 +- 6.5 | -12.5 +- NaN | | 78b-1t1c-ethip6-ip6base | 62.9 +- 12.8 | 62.9 +- 12.8 | 54.0 +- NaN | +0.0 +- 28.8 | -14.1 +- NaN | | 78b-1t1c-ethip6ip6-ip6base-srv6enc1sid | 67.0 +- 5.2 | 67.0 +- 5.2 | 57.0 +- NaN | +0.0 +- 11.1 | -14.9 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 57.5 +- 4.4 | 57.5 +- 4.4 | 48.0 +- NaN | +0.0 +- 10.8 | -16.5 +- NaN | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 200.7 +- 16.2 | 200.7 +- 16.2 | 167.0 +- NaN | +0.0 +- 11.4 | -16.8 +- NaN | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 204.0 +- 15.3 | 204.0 +- 15.3 | 169.0 +- NaN | +0.0 +- 10.6 | -17.2 +- NaN | | 64b-1t1c-ethip4-ip4scale2m | 49.9 +- 14.7 | 49.9 +- 14.7 | 41.0 +- NaN | +0.0 +- 41.5 | -17.8 +- NaN | | 64b-1t1c-ethip4-ip4base-eth-2memif-1dcr | 136.2 +- 7.5 | 136.2 +- 7.5 | 111.0 +- NaN | +0.0 +- 7.8 | -18.5 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 149.6 +- 11.4 | 149.6 +- 11.4 | 121.0 +- NaN | +0.0 +- 10.7 | -19.1 +- NaN | | 64b-1t1c-ethip4-ip4scale20k | 57.8 +- 9.7 | 57.8 +- 9.7 | 44.0 +- NaN | +0.0 +- 23.8 | -23.9 +- NaN | | 64b-1t1c-eth-l2patch | 41.7 +- 3.6 | 41.7 +- 3.6 | 31.0 +- NaN | +0.0 +- 12.2 | -25.7 +- NaN | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 183.0 +- 26.2 | 183.0 +- 26.2 | 135.0 +- NaN | +0.0 +- 20.2 | -26.2 +- NaN | | 78b-1t1c-ethip6-ip6scale200k | 75.1 +- 13.1 | 75.1 +- 13.1 | 54.0 +- NaN | +0.0 +- 24.6 | -28.1 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 53.4 +- 4.1 | 53.4 +- 4.1 | 36.0 +- NaN | +0.0 +- 10.8 | -32.6 +- NaN | | 78b-1t1c-ethip6srhip6-ip6base-srv6enc2sids-nodecaps | 78.2 +- 11.1 | 78.2 +- 11.1 | 0.0 +- NaN | +0.0 +- 20.0 | -100.0 +- NaN | | 78b-1t1c-ethip6srhip6-ip6base-srv6proxy-dyn | 107.9 +- 13.5 | 107.9 +- 13.5 | 0.0 +- NaN | +0.0 +- 17.7 | -100.0 +- NaN | | 78b-1t1c-ethip6srhip6-ip6base-srv6proxy-masq | 118.1 +- 7.3 | 118.1 +- 7.3 | 0.0 +- NaN | +0.0 +- 8.7 | -100.0 +- NaN | +-------------------------------------------------------------------+---------------+---------------+--------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "6" for CSIT rls2101, "7" for CSIT rls2106). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2101.0-7 vs 2101.0-6: Compares CSIT environment current vs previous with previous VPP code. 2106.0-7 vs 2101.0-7: Compares VPP code current vs previous in the current CSIT environment.