+-------------------------------------------------------------------+-------------------+--------------------+--------------------+------------------------+ | Test Case | 2206.0-10 | 2210.0-11 | 2302.0-11 | 2302.0-11 vs 2210.0-11 | +-------------------------------------------------------------------+-------------------+--------------------+--------------------+------------------------+ | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 924.11 +- 284.09 | 1147.0 +- 476.62 | 1232.71 +- 489.26 | +7.47 +- 61.76 | | 64b-1t1c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm | 4929.56 +- 401.73 | 7559.0 +- 3703.81 | 5669.0 +- 436.76 | -25.0 +- 37.2 | | 64b-1t1c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm | 700.0 +- 246.81 | 1973.89 +- 2687.91 | 1248.0 +- 588.33 | -36.77 +- 91.11 | | 78b-1t1c-ethip6-ip6base | 532.12 +- 299.86 | 3663.9 +- 4256.54 | 1492.78 +- 3282.37 | -59.26 +- 101.32 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm | 1465.89 +- 180.37 | 5168.78 +- 4193.29 | 1815.0 +- 865.99 | -64.89 +- 33.05 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm | 1239.88 +- 380.21 | 8268.89 +- 3981.74 | 2675.5 +- 2334.48 | -67.64 +- 32.25 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 1139.22 +- 126.44 | 4678.44 +- 4283.27 | 1489.7 +- 321.08 | -68.16 +- 29.95 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 1593.38 +- 597.03 | 5081.5 +- 4717.03 | 1590.56 +- 327.86 | -68.7 +- 29.76 | | 64b-1t1c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm | 685.33 +- 224.76 | 3190.8 +- 4034.31 | 953.3 +- 366.95 | -70.12 +- 39.49 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm | 1277.0 +- 440.09 | 6260.6 +- 4411.16 | 1785.4 +- 654.18 | -71.48 +- 22.65 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 1470.0 +- 571.96 | 6073.9 +- 4653.61 | 1698.0 +- 503.35 | -72.04 +- 22.97 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 751.62 +- 358.3 | 3505.67 +- 5014.7 | 967.43 +- 436.9 | -72.4 +- 41.4 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 1724.62 +- 74.02 | 6031.11 +- 4116.06 | 1536.3 +- 391.78 | -74.53 +- 18.56 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 1589.9 +- 145.88 | 7242.9 +- 3716.35 | 1821.56 +- 186.82 | -74.85 +- 13.16 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 450.22 +- 123.23 | 2123.8 +- 3562.43 | 529.5 +- 243.68 | -75.07 +- 43.37 | | 64b-1t1c-eth-l2bdbasemaclrn | 543.0 +- 342.1 | 1381.0 +- 2521.27 | 343.2 +- 57.11 | -75.15 +- 45.56 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 1236.56 +- 252.56 | 7197.2 +- 3870.03 | 1746.44 +- 372.32 | -75.73 +- 14.04 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm | 1680.5 +- 763.51 | 6964.9 +- 4548.77 | 1627.0 +- 522.32 | -76.64 +- 17.0 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 1491.17 +- 691.71 | 10611.1 +- 7805.38 | 2347.3 +- 2504.93 | -77.88 +- 28.67 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 353.0 +- 126.11 | 2490.2 +- 3407.08 | 544.1 +- 297.86 | -78.15 +- 32.2 | | 78b-1t1c-ethip6ip6-ip6base-srv6enc1sid | 707.43 +- 347.17 | 2097.5 +- 3488.8 | 401.5 +- 27.1 | -80.86 +- 31.87 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 1253.33 +- 226.37 | 9653.89 +- 7932.35 | 1742.0 +- 583.23 | -81.96 +- 16.01 | | 64b-1t1c-ethip4vxlan-l2xcbase | 519.9 +- 285.54 | 2928.1 +- 4079.91 | 508.5 +- 206.87 | -82.63 +- 25.21 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 422.22 +- 91.59 | 3800.6 +- 4360.67 | 620.44 +- 359.24 | -83.68 +- 20.98 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 448.88 +- 257.07 | 3398.67 +- 4121.59 | 553.5 +- 215.95 | -83.71 +- 20.75 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 1491.78 +- 426.77 | 9182.4 +- 7866.79 | 1479.7 +- 334.95 | -83.89 +- 14.28 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 375.5 +- 142.63 | 3896.0 +- 4231.2 | 589.56 +- 290.48 | -84.87 +- 18.05 | | 64b-1t1c-eth-l2xcbase | 361.44 +- 247.94 | 2929.7 +- 4007.37 | 439.4 +- 287.21 | -85.0 +- 22.74 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 419.11 +- 291.61 | 3821.2 +- 4318.07 | 539.3 +- 277.54 | -85.89 +- 17.52 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 464.5 +- 251.61 | 3976.3 +- 4129.8 | 505.0 +- 210.83 | -87.3 +- 14.22 | | 78b-1t1c-ethip6srhip6-ip6base-srv6enc2sids | 437.67 +- 23.04 | 3963.8 +- 4213.03 | 497.2 +- 33.07 | -87.46 +- 13.36 | | 64b-1t1c-ethip4-ip4base | 535.57 +- 298.45 | 2938.1 +- 4013.89 | 362.78 +- 64.63 | -87.65 +- 17.01 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 604.6 +- 241.91 | 4241.78 +- 4286.02 | 472.7 +- 24.79 | -88.86 +- 11.28 | | 64b-1t1c-eth-l2patch | 137.25 +- 13.36 | 2201.56 +- 3528.1 | 232.1 +- 278.91 | -89.46 +- 21.12 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 507.22 +- 290.71 | 5464.7 +- 4335.5 | 542.3 +- 377.02 | -90.08 +- 10.47 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 375.5 +- 121.68 | 6143.56 +- 3974.54 | 548.8 +- 291.62 | -91.07 +- 7.48 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 508.67 +- 271.02 | 5428.6 +- 4348.58 | 423.0 +- 135.18 | -92.21 +- 6.72 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm-vppip4 | 719.78 +- 59.14 | 9335.0 +- 79.2 | 716.43 +- 76.48 | -92.33 +- 0.82 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 789.67 +- 399.51 | 9283.5 +- 65.76 | 645.57 +- 80.11 | -93.05 +- 0.86 | +-------------------------------------------------------------------+-------------------+--------------------+--------------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210 and rls2302). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2302.0-11 vs 2210.0-11: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.