+-------------------------------------------------------------------+-----------------+-----------------+-----------------+-----------------+----------------------+----------------------+ | Test Case | 2106.0-8 | 2110.0-8 | 2110.0-9 | 2202.0-9 | 2110.0-9 vs 2110.0-8 | 2202.0-9 vs 2110.0-9 | +-------------------------------------------------------------------+-----------------+-----------------+-----------------+-----------------+----------------------+----------------------+ | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 158.8 +- 12.21 | 155.9 +- 13.76 | 159.89 +- 7.11 | 195.5 +- 49.54 | +2.56 +- 10.13 | +22.27 +- 31.46 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 188.6 +- 38.3 | 179.4 +- 34.59 | 163.1 +- 12.76 | 186.6 +- 48.05 | -9.09 +- 18.92 | +14.41 +- 30.79 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm | 210.7 +- 21.23 | 204.0 +- 16.95 | 177.22 +- 21.66 | 198.8 +- 28.22 | -13.13 +- 12.84 | +12.18 +- 21.01 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 59.78 +- 7.24 | 59.8 +- 12.87 | 57.11 +- 11.99 | 63.0 +- 8.38 | -4.5 +- 28.72 | +10.31 +- 27.42 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 48.9 +- 1.91 | 47.4 +- 3.34 | 43.9 +- 7.34 | 47.9 +- 3.45 | -7.38 +- 16.8 | +9.11 +- 19.86 | | 64b-1t1c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm | 107.1 +- 17.21 | 101.9 +- 17.89 | 109.1 +- 13.19 | 118.4 +- 11.85 | +7.07 +- 22.82 | +8.52 +- 17.03 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 178.0 +- 18.28 | 168.2 +- 15.33 | 166.56 +- 18.48 | 180.5 +- 16.77 | -0.98 +- 14.22 | +8.37 +- 15.68 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 51.67 +- 3.57 | 47.8 +- 4.21 | 45.5 +- 2.51 | 49.2 +- 2.74 | -4.81 +- 9.89 | +8.13 +- 8.47 | | 78b-1t1c-ethip6-ip6base | 48.1 +- 5.04 | 48.5 +- 4.7 | 49.5 +- 5.13 | 53.2 +- 5.14 | +2.06 +- 14.47 | +7.47 +- 15.22 | | 78b-1t1c-ethip6ip6-ip6base-srv6enc1sid | 61.78 +- 5.74 | 64.11 +- 5.25 | 62.89 +- 4.83 | 67.25 +- 4.27 | -1.91 +- 11.02 | +6.93 +- 10.66 | | 64b-1t1c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm | 95.56 +- 12.54 | 94.75 +- 8.8 | 99.0 +- 12.03 | 105.7 +- 6.53 | +4.49 +- 15.98 | +6.77 +- 14.55 | | 64b-1t1c-eth-l2bdbasemaclrn | 53.8 +- 4.42 | 54.1 +- 5.57 | 52.0 +- 2.45 | 54.75 +- 5.12 | -3.88 +- 10.88 | +5.29 +- 11.02 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 50.7 +- 4.47 | 48.6 +- 2.72 | 47.0 +- 2.62 | 48.8 +- 4.66 | -3.29 +- 7.64 | +3.83 +- 11.49 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 46.5 +- 4.79 | 43.78 +- 8.04 | 46.67 +- 6.98 | 48.44 +- 7.43 | +6.6 +- 25.26 | +3.81 +- 22.25 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 48.12 +- 2.03 | 47.7 +- 4.32 | 46.1 +- 4.72 | 47.4 +- 3.6 | -3.35 +- 13.22 | +2.82 +- 13.11 | | 78b-1t1c-ethip6srhip6-ip6base-srv6enc2sids | 71.6 +- 4.38 | 70.1 +- 3.93 | 72.2 +- 6.34 | 74.11 +- 4.88 | +3.0 +- 10.73 | +2.65 +- 11.27 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 51.8 +- 2.49 | 49.1 +- 2.6 | 47.4 +- 2.12 | 48.44 +- 2.19 | -3.46 +- 6.69 | +2.2 +- 6.49 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 80.0 +- 6.58 | 79.9 +- 5.2 | 77.9 +- 4.7 | 79.38 +- 5.8 | -2.5 +- 8.65 | +1.89 +- 9.66 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 51.1 +- 3.93 | 47.5 +- 3.1 | 47.67 +- 4.12 | 48.5 +- 2.42 | +0.35 +- 10.87 | +1.75 +- 10.16 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 195.1 +- 24.82 | 222.78 +- 11.58 | 201.0 +- 31.72 | 203.8 +- 13.24 | -9.78 +- 14.99 | +1.39 +- 17.3 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 166.3 +- 14.85 | 167.9 +- 17.37 | 172.5 +- 16.45 | 173.11 +- 21.88 | +2.74 +- 14.46 | +0.35 +- 15.89 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 169.38 +- 16.72 | 165.78 +- 14.02 | 170.5 +- 20.49 | 170.11 +- 20.27 | +2.85 +- 15.11 | -0.23 +- 16.89 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm | 176.0 +- 13.99 | 179.78 +- 19.95 | 174.0 +- 16.07 | 173.6 +- 31.59 | -3.21 +- 13.97 | -0.23 +- 20.36 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 224.11 +- 28.2 | 226.5 +- 18.75 | 226.5 +- 24.88 | 224.4 +- 41.53 | +0.0 +- 13.75 | -0.93 +- 21.32 | | 64b-1t1c-ethip4-ip4base | 51.33 +- 4.3 | 50.6 +- 3.72 | 52.11 +- 4.43 | 51.43 +- 2.57 | +2.99 +- 11.57 | -1.31 +- 9.73 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm | 206.8 +- 13.52 | 201.7 +- 25.07 | 221.0 +- 18.39 | 215.11 +- 13.69 | +9.57 +- 16.39 | -2.66 +- 10.2 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 47.9 +- 2.23 | 48.6 +- 4.03 | 47.8 +- 3.08 | 46.5 +- 2.55 | -1.65 +- 10.34 | -2.72 +- 8.24 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 186.33 +- 27.16 | 209.9 +- 15.36 | 196.3 +- 16.04 | 189.9 +- 11.7 | -6.48 +- 10.26 | -3.26 +- 9.9 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 175.6 +- 24.96 | 197.1 +- 16.9 | 199.7 +- 25.85 | 193.12 +- 29.83 | +1.32 +- 15.73 | -3.29 +- 19.49 | | 64b-1t1c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm | 271.56 +- 48.04 | 224.4 +- 16.55 | 221.0 +- 22.25 | 212.7 +- 23.4 | -1.52 +- 12.29 | -3.76 +- 14.35 | | 64b-1t1c-eth-l2patch | 35.5 +- 2.46 | 35.44 +- 1.81 | 37.11 +- 1.83 | 35.11 +- 2.2 | +4.7 +- 7.44 | -5.39 +- 7.56 | | 64b-1t1c-ethip4vxlan-l2xcbase | 69.1 +- 19.76 | 67.7 +- 19.52 | 66.33 +- 16.83 | 62.2 +- 13.57 | -2.02 +- 37.63 | -6.23 +- 31.38 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 165.7 +- 9.6 | 167.0 +- 13.6 | 177.9 +- 4.61 | 166.3 +- 7.6 | +6.53 +- 9.1 | -6.52 +- 4.91 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 48.78 +- 1.86 | 47.6 +- 2.99 | 50.3 +- 3.95 | 46.89 +- 3.26 | +5.67 +- 10.62 | -6.78 +- 9.77 | | 64b-1t1c-eth-l2xcbase | 46.5 +- 4.57 | 50.1 +- 3.07 | 51.22 +- 4.55 | 47.3 +- 4.0 | +2.24 +- 11.03 | -7.66 +- 11.33 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm | 220.33 +- 21.67 | 208.22 +- 22.14 | 219.0 +- 21.53 | 195.7 +- 20.53 | +5.18 +- 15.23 | -10.64 +- 12.85 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 152.4 +- 12.18 | 151.25 +- 18.77 | 142.0 +- 14.36 | 122.7 +- 5.83 | -6.12 +- 15.03 | -13.59 +- 9.66 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 130.56 +- 13.63 | 123.33 +- 12.1 | 127.8 +- 15.24 | 110.38 +- 14.46 | +3.62 +- 16.01 | -13.63 +- 15.3 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm-vppip4 | 146.33 +- 24.98 | 151.5 +- 12.51 | 138.6 +- 15.36 | 119.11 +- 18.35 | -8.51 +- 12.64 | -14.06 +- 16.31 | +-------------------------------------------------------------------+-----------------+-----------------+-----------------+-----------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "8" for CSIT rls2110, "9" for CSIT rls2202). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2110.0-9 vs 2110.0-8: Compares CSIT environment current vs previous with previous VPP code. 2202.0-9 vs 2110.0-9: Compares VPP code current vs previous in the current CSIT environment.