+-----------------------------------------------------------------------+---------------+----------------+---------------+----------------------+----------------------+ | Test Case | 2101.0-6 | 2101.0-7 | 2106.0-7 | 2101.0-7 vs 2101.0-6 | 2106.0-7 vs 2101.0-7 | +-----------------------------------------------------------------------+---------------+----------------+---------------+----------------------+----------------------+ | 1518b-2t1c-avf-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 472.5 +- 80.3 | 649.3 +- 856.1 | 2852.0 +- NaN | +37.4 +- 182.7 | +339.2 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 295.5 +- 29.5 | 422.4 +- 27.3 | 653.0 +- NaN | +42.9 +- 17.0 | +54.6 +- NaN | | 78b-2t1c-ethip6-ip6scale2m | 181.5 +- 31.3 | 131.7 +- 20.4 | 192.0 +- NaN | -27.4 +- 16.8 | +45.8 +- NaN | | 64b-2t1c-eth-l2patch | 98.7 +- 47.5 | 80.4 +- 4.0 | 114.0 +- NaN | -18.5 +- 39.4 | +41.8 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale20k | 119.3 +- 44.3 | 108.4 +- 11.5 | 153.0 +- NaN | -9.1 +- 35.1 | +41.1 +- NaN | | 64b-2t1c-eth-l2xcbase | 115.5 +- 49.4 | 113.9 +- 4.9 | 154.0 +- NaN | -1.4 +- 42.4 | +35.2 +- NaN | | 64b-2t1c-ethip4-ip4scale2m | 147.3 +- 45.5 | 141.5 +- 21.9 | 191.0 +- NaN | -3.9 +- 33.2 | +35.0 +- NaN | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 108.4 +- 42.2 | 117.8 +- 8.6 | 156.0 +- NaN | +8.7 +- 43.1 | +32.4 +- NaN | | 1518b-2t1c-avf-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 865.3 +- 78.1 | 733.5 +- 57.8 | 937.0 +- NaN | -15.2 +- 10.2 | +27.7 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale200k | 117.9 +- 44.1 | 121.6 +- 54.5 | 155.0 +- NaN | +3.1 +- 60.2 | +27.5 +- NaN | | 64b-2t1c-ethip4-ip4base | 135.9 +- 44.8 | 124.0 +- 7.5 | 158.0 +- NaN | -8.8 +- 30.5 | +27.4 +- NaN | | 78b-2t1c-avf-ethip6srhip6-ip6base-srv6enc2sids | 145.7 +- 44.0 | 154.1 +- 8.6 | 196.0 +- NaN | +5.8 +- 32.5 | +27.2 +- NaN | | 1518b-2t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 502.1 +- 35.3 | 440.3 +- 73.7 | 547.0 +- NaN | -12.3 +- 15.9 | +24.2 +- NaN | | 64b-2t1c-eth-l2xcbase-eth-2memif-1lxc | 318.5 +- 22.7 | 385.2 +- 19.3 | 475.0 +- NaN | +20.9 +- 10.5 | +23.3 +- NaN | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 331.9 +- 30.7 | 383.6 +- 25.6 | 472.0 +- NaN | +15.6 +- 13.2 | +23.0 +- NaN | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 415.2 +- 24.8 | 426.8 +- 74.6 | 524.0 +- NaN | +2.8 +- 19.0 | +22.8 +- NaN | | 78b-2t1c-avf-ethip6ip6-ip6base-srv6enc1sid | 125.8 +- 43.7 | 144.2 +- 4.7 | 177.0 +- NaN | +14.6 +- 40.0 | +22.7 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1lxc | 257.6 +- 25.6 | 366.9 +- 32.5 | 449.0 +- NaN | +42.4 +- 19.0 | +22.4 +- NaN | | 64b-2t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 297.5 +- 14.9 | 445.7 +- 18.7 | 544.0 +- NaN | +49.8 +- 9.8 | +22.1 +- NaN | | 64b-2t1c-avf-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 327.0 +- 29.5 | 421.2 +- 48.1 | 505.0 +- NaN | +28.8 +- 18.7 | +19.9 +- NaN | | 64b-2t1c-ethip4-ip4base-eth-2vhostvr1024-1vm | 357.2 +- 24.1 | 507.9 +- 28.3 | 597.0 +- NaN | +42.2 +- 12.4 | +17.5 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 306.8 +- 22.5 | 421.7 +- 10.1 | 494.0 +- NaN | +37.5 +- 10.6 | +17.1 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 328.6 +- 16.7 | 470.6 +- 13.7 | 542.0 +- NaN | +43.2 +- 8.4 | +15.2 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 106.0 +- 42.2 | 108.2 +- 11.3 | 124.0 +- NaN | +2.1 +- 42.0 | +14.6 +- NaN | | 1518b-2t1c-avf-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 827.7 +- 42.7 | 879.5 +- 200.4 | 1001.0 +- NaN | +6.3 +- 24.8 | +13.8 +- NaN | | 64b-2t1c-avf-ethip4-ip4base-eth-2vhostvr1024-1vm | 335.7 +- 25.4 | 423.0 +- 15.9 | 480.0 +- NaN | +26.0 +- 10.6 | +13.5 +- NaN | | 64b-2t1c-avf-ethip4-ip4base-eth-2vhostvr1024-1vm-vppip4 | 348.8 +- 37.4 | 360.6 +- 46.3 | 409.0 +- NaN | +3.4 +- 17.3 | +13.4 +- NaN | | 1518b-2t1c-avf-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 897.4 +- 10.1 | 813.5 +- 85.3 | 914.0 +- NaN | -9.3 +- 9.6 | +12.4 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn | 135.6 +- 45.5 | 125.8 +- 13.2 | 141.0 +- NaN | -7.2 +- 32.6 | +12.1 +- NaN | | 78b-2t1c-avf-ethip6-ip6base | 113.3 +- 50.4 | 100.9 +- 3.3 | 113.0 +- NaN | -10.9 +- 39.7 | +12.0 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale2m | 122.2 +- 34.3 | 143.7 +- 31.3 | 160.0 +- NaN | +17.6 +- 41.8 | +11.3 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 305.0 +- 42.7 | 369.3 +- 47.2 | 411.0 +- NaN | +21.1 +- 23.0 | +11.3 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale20k | 114.0 +- 41.8 | 111.5 +- 10.9 | 122.0 +- NaN | -2.2 +- 37.1 | +9.4 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1lxc | 327.1 +- 16.4 | 421.0 +- 13.0 | 459.0 +- NaN | +28.7 +- 7.6 | +9.0 +- NaN | | 1518b-2t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 382.9 +- 48.8 | 423.4 +- 45.7 | 461.0 +- NaN | +10.6 +- 18.5 | +8.9 +- NaN | | 78b-2t1c-ethip6-ip6base | 126.1 +- 47.0 | 106.8 +- 7.6 | 114.0 +- NaN | -15.3 +- 32.1 | +6.7 +- NaN | | 64b-2t1c-avf-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 331.7 +- 13.3 | 551.7 +- 19.2 | 588.0 +- NaN | +66.3 +- 8.8 | +6.6 +- NaN | | 1518b-2t1c-avf-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 392.8 +- 25.8 | 420.8 +- 73.0 | 443.0 +- NaN | +7.1 +- 19.9 | +5.3 +- NaN | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 115.4 +- 37.5 | 128.4 +- 8.2 | 135.0 +- NaN | +11.3 +- 36.8 | +5.1 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1lxc | 231.7 +- 43.0 | 329.4 +- 49.3 | 346.0 +- NaN | +42.2 +- 33.9 | +5.0 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 232.1 +- 34.9 | 337.8 +- 62.6 | 350.0 +- NaN | +45.5 +- 34.7 | +3.6 +- NaN | | 64b-2t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 343.8 +- 14.5 | 606.4 +- 9.7 | 620.0 +- NaN | +76.4 +- 8.0 | +2.2 +- NaN | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 116.9 +- 33.2 | 119.5 +- 4.9 | 122.0 +- NaN | +2.2 +- 29.4 | +2.1 +- NaN | | 1518b-2t1c-avf-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 391.8 +- 36.1 | 385.4 +- 55.1 | 392.0 +- NaN | -1.6 +- 16.7 | +1.7 +- NaN | | 64b-2t1c-ethip4vxlan-l2xcbase | 145.5 +- 45.6 | 192.0 +- 5.7 | 195.0 +- NaN | +32.0 +- 41.5 | +1.6 +- NaN | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 338.8 +- 13.7 | 382.8 +- 53.9 | 371.0 +- NaN | +13.0 +- 16.5 | -3.1 +- NaN | | 64b-2t1c-ethip4vxlan-l2bdbasemaclrn | 165.1 +- 44.0 | 241.4 +- 6.7 | 232.0 +- NaN | +46.2 +- 39.2 | -3.9 +- NaN | | 64b-2t1c-avf-ethip4-ip4base | 110.9 +- 44.0 | 108.0 +- 9.9 | 103.0 +- NaN | -2.6 +- 39.7 | -4.6 +- NaN | | 64b-2t1c-avf-ethip4vxlan-l2xcbase | 129.8 +- 45.6 | 165.7 +- 4.7 | 157.0 +- NaN | +27.7 +- 45.0 | -5.3 +- NaN | | 64b-2t1c-avf-ethip4vxlan-l2bdbasemaclrn | 144.6 +- 43.8 | 200.8 +- 5.5 | 187.0 +- NaN | +38.9 +- 42.3 | -6.9 +- NaN | | 64b-2t1c-avf-eth-l2patch | 67.3 +- 46.0 | 53.5 +- 11.6 | 48.0 +- NaN | -20.5 +- 57.0 | -10.3 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 260.4 +- 26.0 | 283.5 +- 36.5 | 252.0 +- NaN | +8.9 +- 17.8 | -11.1 +- NaN | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 146.0 +- 29.2 | 177.2 +- 79.4 | 146.0 +- NaN | +21.4 +- 59.5 | -17.6 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale200k | 140.4 +- 29.5 | 252.6 +- 181.1 | 192.0 +- NaN | +79.9 +- 134.4 | -24.0 +- NaN | | 64b-2t1c-avf-eth-l2xcbase | 71.5 +- 33.8 | 90.4 +- 7.0 | 68.0 +- NaN | +26.4 +- 60.6 | -24.8 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale2m | 161.7 +- 30.7 | 174.2 +- 85.5 | 122.0 +- NaN | +7.7 +- 56.7 | -30.0 +- NaN | | 64b-2t1c-eth-l2bdscale1mmaclrn | 244.7 +- 55.3 | 334.0 +- 278.1 | 207.0 +- NaN | +36.5 +- 117.8 | -38.0 +- NaN | | 78b-2t1c-avf-ethip6srhip6-ip6base-srv6enc2sids-nodecaps | 137.6 +- 45.5 | 143.7 +- 11.0 | 0.0 +- NaN | +4.4 +- 35.4 | -100.0 +- NaN | | 78b-2t1c-avf-ethip6srhip6-ip6base-srv6proxy-dyn | 41.6 +- 62.2 | 215.8 +- 79.0 | 0.0 +- NaN | +418.8 +- 799.0 | -100.0 +- NaN | | 78b-2t1c-avf-ethip6srhip6-ip6base-srv6proxy-masq | 204.4 +- 54.5 | 263.5 +- 11.2 | 0.0 +- NaN | +28.9 +- 34.8 | -100.0 +- NaN | +-----------------------------------------------------------------------+---------------+----------------+---------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "6" for CSIT rls2101, "7" for CSIT rls2106). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2101.0-7 vs 2101.0-6: Compares CSIT environment current vs previous with previous VPP code. 2106.0-7 vs 2101.0-7: Compares VPP code current vs previous in the current CSIT environment.