+-------------------------------------------------------------------+-------------------+------------------+------------------+------------------+----------------------+----------------------+ | Test Case | 2106.0-8 | 2110.0-8 | 2110.0-9 | 2202.0-9 | 2110.0-9 vs 2110.0-8 | 2202.0-9 vs 2110.0-9 | +-------------------------------------------------------------------+-------------------+------------------+------------------+------------------+----------------------+----------------------+ | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 453.7 +- 88.02 | 490.3 +- 147.17 | 408.7 +- 31.99 | 509.3 +- 106.09 | -16.64 +- 25.86 | +24.61 +- 27.73 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 395.7 +- 27.75 | 393.7 +- 20.6 | 395.0 +- 25.07 | 485.5 +- 117.18 | +0.33 +- 8.25 | +22.91 +- 30.67 | | 78b-1t1c-ethip6-ip6base | 106.4 +- 6.45 | 108.1 +- 3.96 | 106.7 +- 4.62 | 129.6 +- 7.53 | -1.3 +- 5.6 | +21.46 +- 8.8 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm | 419.1 +- 36.52 | 413.0 +- 42.7 | 427.0 +- 42.18 | 503.1 +- 134.35 | +3.39 +- 14.78 | +17.82 +- 33.55 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 92.0 +- 4.83 | 83.6 +- 5.74 | 83.2 +- 4.39 | 94.2 +- 4.29 | -0.48 +- 8.62 | +13.22 +- 7.89 | | 78b-1t1c-ethip6srhip6-ip6base-srv6enc2sids | 168.7 +- 4.5 | 172.8 +- 3.16 | 172.2 +- 1.81 | 192.78 +- 2.05 | -0.35 +- 2.1 | +11.95 +- 1.67 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 85.5 +- 3.1 | 239.7 +- 481.52 | 82.2 +- 4.8 | 91.44 +- 7.06 | -65.71 +- 68.92 | +11.25 +- 10.77 | | 64b-1t1c-ethip4-ip4base | 121.56 +- 3.81 | 123.0 +- 2.87 | 122.22 +- 1.86 | 135.43 +- 2.99 | -0.63 +- 2.76 | +10.81 +- 2.97 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 564.7 +- 113.46 | 562.5 +- 30.34 | 552.1 +- 39.38 | 601.75 +- 149.59 | -1.85 +- 8.78 | +8.99 +- 28.19 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 88.8 +- 2.25 | 84.5 +- 3.72 | 80.9 +- 18.3 | 87.6 +- 3.53 | -4.26 +- 22.06 | +8.28 +- 24.88 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 488.8 +- 66.47 | 494.2 +- 52.18 | 492.8 +- 47.17 | 532.11 +- 113.0 | -0.28 +- 14.21 | +7.98 +- 25.15 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 90.33 +- 3.97 | 89.0 +- 8.06 | 85.0 +- 5.08 | 91.5 +- 5.62 | -4.49 +- 10.36 | +7.65 +- 9.22 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 107.7 +- 8.11 | 109.56 +- 5.5 | 103.0 +- 4.77 | 110.22 +- 13.34 | -5.98 +- 6.42 | +7.01 +- 13.87 | | 78b-1t1c-ethip6ip6-ip6base-srv6enc1sid | 157.33 +- 4.82 | 165.44 +- 1.81 | 165.67 +- 3.67 | 176.25 +- 4.37 | +0.13 +- 2.48 | +6.39 +- 3.54 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 607.25 +- 186.3 | 554.22 +- 142.34 | 530.62 +- 153.47 | 564.22 +- 125.06 | -4.26 +- 37.03 | +6.33 +- 38.75 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 88.5 +- 4.54 | 91.6 +- 3.63 | 88.5 +- 2.84 | 94.1 +- 2.33 | -3.38 +- 4.92 | +6.33 +- 4.31 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 88.56 +- 5.7 | 89.4 +- 5.17 | 84.0 +- 5.01 | 89.11 +- 2.26 | -6.04 +- 7.81 | +6.08 +- 6.88 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm | 547.1 +- 97.32 | 521.0 +- 81.92 | 535.67 +- 116.53 | 568.1 +- 94.62 | +2.82 +- 27.6 | +6.05 +- 29.06 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 516.0 +- 93.51 | 515.9 +- 78.24 | 500.11 +- 18.5 | 526.2 +- 91.22 | -3.06 +- 15.13 | +5.22 +- 18.65 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 93.1 +- 4.07 | 95.2 +- 4.16 | 89.8 +- 4.05 | 94.2 +- 4.37 | -5.67 +- 5.92 | +4.9 +- 6.78 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 208.3 +- 3.71 | 215.6 +- 3.84 | 215.1 +- 3.78 | 224.12 +- 3.18 | -0.23 +- 2.5 | +4.2 +- 2.36 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 86.2 +- 4.37 | 84.5 +- 5.6 | 82.78 +- 5.24 | 86.2 +- 4.94 | -2.04 +- 8.98 | +4.13 +- 8.89 | | 64b-1t1c-ethip4vxlan-l2xcbase | 173.3 +- 2.0 | 180.9 +- 3.31 | 181.0 +- 1.66 | 187.7 +- 1.89 | +0.06 +- 2.05 | +3.7 +- 1.41 | | 64b-1t1c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm | 285.8 +- 4.57 | 284.8 +- 7.08 | 278.9 +- 8.05 | 287.7 +- 8.21 | -2.07 +- 3.73 | +3.16 +- 4.19 | | 64b-1t1c-eth-l2bdbasemaclrn | 129.7 +- 4.03 | 129.7 +- 3.09 | 129.3 +- 3.65 | 133.0 +- 1.85 | -0.31 +- 3.69 | +2.86 +- 3.24 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 145.44 +- 6.11 | 149.2 +- 3.82 | 149.44 +- 2.88 | 153.56 +- 4.1 | +0.16 +- 3.21 | +2.75 +- 3.38 | | 64b-1t1c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm | 278.22 +- 5.54 | 273.0 +- 5.45 | 275.4 +- 5.58 | 279.5 +- 6.98 | +0.88 +- 2.87 | +1.49 +- 3.26 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm | 552.56 +- 18.34 | 587.22 +- 84.04 | 556.44 +- 50.64 | 558.7 +- 93.15 | -5.24 +- 16.07 | +0.41 +- 19.07 | | 64b-1t1c-eth-l2patch | 59.6 +- 3.81 | 62.22 +- 2.59 | 61.67 +- 4.47 | 61.67 +- 1.73 | -0.89 +- 8.29 | +0.0 +- 7.78 | | 64b-1t1c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm | 1516.22 +- 280.53 | 1535.2 +- 229.86 | 1369.7 +- 299.87 | 1348.9 +- 232.37 | -10.78 +- 23.66 | -1.52 +- 27.44 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm-vppip4 | 360.44 +- 5.92 | 362.9 +- 12.91 | 366.5 +- 5.84 | 340.78 +- 9.98 | +0.99 +- 3.93 | -7.02 +- 3.1 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 640.67 +- 98.8 | 668.6 +- 117.2 | 629.9 +- 70.69 | 583.5 +- 171.08 | -5.79 +- 19.61 | -7.37 +- 29.08 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 413.8 +- 11.32 | 425.0 +- 16.66 | 418.5 +- 20.37 | 372.7 +- 17.93 | -1.53 +- 6.15 | -10.94 +- 6.09 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm | 462.0 +- 37.99 | 440.0 +- 16.09 | 475.88 +- 43.29 | 423.33 +- 32.6 | +8.15 +- 10.6 | -11.04 +- 10.6 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 568.67 +- 92.03 | 548.2 +- 54.2 | 561.5 +- 63.8 | 494.5 +- 24.02 | +2.43 +- 15.43 | -11.93 +- 10.88 | | 64b-1t1c-eth-l2xcbase | 116.38 +- 2.0 | 121.8 +- 2.74 | 123.33 +- 3.04 | 107.8 +- 5.35 | +1.26 +- 3.38 | -12.59 +- 4.84 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 342.7 +- 6.33 | 353.5 +- 6.21 | 346.22 +- 12.27 | 299.3 +- 10.56 | -2.06 +- 3.87 | -13.55 +- 4.32 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 299.44 +- 11.33 | 303.44 +- 14.2 | 302.6 +- 18.67 | 261.5 +- 23.91 | -0.28 +- 7.72 | -13.58 +- 9.53 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 520.0 +- 67.33 | 532.56 +- 47.95 | 580.0 +- 91.46 | 472.2 +- 42.55 | +8.91 +- 19.78 | -18.59 +- 14.79 | +-------------------------------------------------------------------+-------------------+------------------+------------------+------------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "8" for CSIT rls2110, "9" for CSIT rls2202). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2110.0-9 vs 2110.0-8: Compares CSIT environment current vs previous with previous VPP code. 2202.0-9 vs 2110.0-9: Compares VPP code current vs previous in the current CSIT environment.