+-------------------------------------------------------------------+-------------------+------------------+------------------+------------------------+ | Test Case | 2206.0-10 | 2210.0-11 | 2302.0-11 | 2302.0-11 vs 2210.0-11 | +-------------------------------------------------------------------+-------------------+------------------+------------------+------------------------+ | 64b-1t1c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm | 1642.56 +- 33.8 | 1619.3 +- 150.95 | 2356.2 +- 49.88 | +45.51 +- 13.91 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 768.2 +- 171.2 | 605.9 +- 184.42 | 739.89 +- 337.52 | +22.11 +- 66.97 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 463.89 +- 47.98 | 476.2 +- 112.19 | 563.0 +- 185.65 | +18.23 +- 47.91 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm | 641.5 +- 95.84 | 707.4 +- 79.93 | 805.5 +- 105.23 | +13.87 +- 19.67 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 491.5 +- 43.15 | 723.7 +- 137.75 | 817.0 +- 137.64 | +12.89 +- 28.7 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 256.8 +- 4.39 | 260.0 +- 79.19 | 289.8 +- 6.88 | +11.46 +- 34.05 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 136.11 +- 15.07 | 140.3 +- 11.79 | 152.89 +- 13.85 | +8.97 +- 13.46 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 662.78 +- 93.93 | 745.67 +- 119.65 | 809.4 +- 84.96 | +8.55 +- 20.81 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm | 552.38 +- 36.39 | 718.44 +- 94.61 | 760.62 +- 77.44 | +5.87 +- 17.62 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 318.62 +- 18.37 | 342.67 +- 21.13 | 353.57 +- 15.22 | +3.18 +- 7.76 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 573.29 +- 22.77 | 754.6 +- 156.53 | 772.3 +- 66.57 | +2.35 +- 22.99 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm | 484.89 +- 52.79 | 476.89 +- 116.48 | 487.7 +- 72.48 | +2.27 +- 29.24 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 253.22 +- 13.35 | 269.5 +- 9.19 | 275.43 +- 6.75 | +2.2 +- 4.29 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 584.62 +- 95.23 | 684.1 +- 148.23 | 698.44 +- 102.46 | +2.1 +- 26.72 | | 64b-1t1c-ethip4-ip4base | 165.71 +- 8.98 | 183.5 +- 7.04 | 186.89 +- 6.64 | +1.85 +- 5.33 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 403.56 +- 9.76 | 427.33 +- 15.28 | 433.43 +- 22.49 | +1.43 +- 6.39 | | 64b-1t1c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm | 309.33 +- 11.84 | 364.2 +- 47.16 | 368.0 +- 11.47 | +1.04 +- 13.46 | | 64b-1t1c-ethip4vxlan-l2xcbase | 211.0 +- 9.3 | 241.2 +- 20.87 | 243.1 +- 6.12 | +0.79 +- 9.08 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 111.5 +- 12.33 | 139.2 +- 8.93 | 138.56 +- 9.4 | -0.46 +- 9.29 | | 64b-1t1c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm | 292.78 +- 23.07 | 370.44 +- 29.71 | 366.2 +- 19.8 | -1.15 +- 9.56 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 118.67 +- 15.74 | 137.7 +- 28.81 | 133.0 +- 12.66 | -3.41 +- 22.2 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 643.0 +- 130.3 | 802.33 +- 269.31 | 772.56 +- 77.69 | -3.71 +- 33.74 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 572.56 +- 115.95 | 720.3 +- 75.75 | 688.9 +- 72.4 | -4.36 +- 14.22 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm-vppip4 | 333.22 +- 18.53 | 375.5 +- 37.48 | 358.57 +- 13.53 | -4.51 +- 10.19 | | 78b-1t1c-ethip6ip6-ip6base-srv6enc1sid | 190.86 +- 5.43 | 235.7 +- 22.04 | 224.6 +- 5.32 | -4.71 +- 9.19 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 120.38 +- 12.63 | 148.7 +- 9.8 | 141.0 +- 13.12 | -5.18 +- 10.81 | | 64b-1t1c-eth-l2bdbasemaclrn | 151.44 +- 8.82 | 196.2 +- 8.85 | 185.4 +- 9.89 | -5.5 +- 6.6 | | 78b-1t1c-ethip6srhip6-ip6base-srv6enc2sids | 213.11 +- 11.89 | 262.9 +- 21.69 | 246.0 +- 8.92 | -6.43 +- 8.43 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 168.9 +- 14.15 | 246.9 +- 26.91 | 229.56 +- 6.71 | -7.02 +- 10.49 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 499.75 +- 59.21 | 563.0 +- 124.11 | 522.9 +- 95.92 | -7.12 +- 26.64 | | 64b-1t1c-eth-l2patch | 72.25 +- 6.9 | 79.67 +- 8.26 | 73.8 +- 3.58 | -7.36 +- 10.61 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 115.25 +- 8.4 | 163.89 +- 30.13 | 151.8 +- 11.65 | -7.38 +- 18.46 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm | 557.67 +- 35.93 | 695.5 +- 189.16 | 635.25 +- 127.31 | -8.66 +- 30.86 | | 64b-1t1c-eth-l2xcbase | 136.56 +- 5.13 | 177.9 +- 16.52 | 158.8 +- 5.57 | -10.74 +- 8.86 | | 78b-1t1c-ethip6-ip6base | 151.12 +- 21.77 | 180.4 +- 27.41 | 156.22 +- 16.62 | -13.4 +- 16.06 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 115.44 +- 10.96 | 156.3 +- 37.33 | 133.3 +- 11.11 | -14.72 +- 21.57 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 120.0 +- 11.08 | 162.4 +- 48.78 | 137.11 +- 9.43 | -15.57 +- 26.02 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 113.33 +- 19.09 | 150.7 +- 37.69 | 126.5 +- 12.14 | -16.06 +- 22.49 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 114.62 +- 15.77 | 154.33 +- 37.84 | 126.7 +- 14.61 | -17.9 +- 22.24 | +-------------------------------------------------------------------+-------------------+------------------+------------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210 and rls2302). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2302.0-11 vs 2210.0-11: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.