+--------------------------------------------------------------------+----------------+---------------+---------------+------------------------+ | Test Case | 2206.0-10 | 2210.0-11 | 2302.0-11 | 2302.0-11 vs 2210.0-11 | +--------------------------------------------------------------------+----------------+---------------+---------------+------------------------+ | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 33.6 +- 5.66 | 26.9 +- 8.65 | 34.0 +- 13.21 | +26.39 +- 63.73 | | 64b-1t1c-eth-l2bdscale100kmaclrn | 25.2 +- 4.24 | 26.9 +- 3.73 | 31.8 +- 5.25 | +18.22 +- 25.46 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 26.5 +- 11.83 | 28.8 +- 3.77 | 33.4 +- 4.55 | +15.97 +- 21.9 | | 78b-1t1c-af-xdp-ethip6-ip6scale20k | 15.0 +- 0.47 | 19.3 +- 2.06 | 22.2 +- 4.02 | +15.03 +- 24.18 | | 64b-1t1c-ethip4ipsec1000spe-cache-ip4base-policy-outbound-nocrypto | 31.3 +- 7.8 | 28.4 +- 4.79 | 32.2 +- 5.31 | +13.38 +- 26.74 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 27.8 +- 7.84 | 32.5 +- 3.21 | 36.1 +- 5.51 | +11.08 +- 20.18 | | 64b-1t1c-ethip4-ip4base-eth-2memif-1dcr | 39.5 +- 6.45 | 40.2 +- 6.55 | 43.2 +- 4.96 | +7.46 +- 21.41 | | 64b-1t1c-ethip4ipsec100spe-cache-ip4base-policy-outbound-nocrypto | 32.9 +- 6.05 | 31.6 +- 5.78 | 33.9 +- 4.48 | +7.28 +- 24.21 | | 64b-1t1c-af-xdp-ethip4-ip4scale200k | 15.3 +- 0.48 | 17.9 +- 0.74 | 19.0 +- 4.06 | +6.15 +- 23.07 | | 78b-1t1c-af-xdp-ethip6-ip6base | 15.1 +- 0.32 | 19.4 +- 2.12 | 20.5 +- 4.93 | +5.67 +- 27.9 | | 64b-1t1c-af-xdp-eth-l2bdscale10kmaclrn | 15.0 +- 0.0 | 17.5 +- 0.53 | 18.3 +- 1.49 | +4.57 +- 9.1 | | 78b-1t1c-ethip6-ip6base | 22.0 +- 4.35 | 23.7 +- 2.63 | 24.5 +- 2.12 | +3.38 +- 14.54 | | 64b-1t1c-eth-l2patch | 18.8 +- 2.66 | 19.6 +- 3.06 | 20.2 +- 2.49 | +3.06 +- 20.5 | | 64b-1t1c-eth-l2bdscale10kmaclrn | 26.5 +- 2.99 | 26.9 +- 3.75 | 27.7 +- 4.06 | +2.97 +- 20.83 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 26.7 +- 8.81 | 31.5 +- 5.04 | 32.2 +- 5.09 | +2.22 +- 23.0 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 29.3 +- 4.57 | 34.8 +- 9.91 | 35.4 +- 7.92 | +1.72 +- 36.83 | | 64b-1t1c-af-xdp-eth-l2patch | 14.1 +- 0.32 | 18.7 +- 5.87 | 19.0 +- 3.94 | +1.6 +- 38.24 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 25.0 +- 2.58 | 27.1 +- 3.38 | 27.5 +- 3.6 | +1.48 +- 18.35 | | 64b-1t1c-ethip4ipsec1spe-cache-ip4base-policy-outbound-nocrypto | 27.6 +- 8.22 | 30.1 +- 5.63 | 30.5 +- 5.15 | +1.33 +- 25.52 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 27.5 +- 4.17 | 35.7 +- 8.11 | 36.1 +- 9.65 | +1.12 +- 35.49 | | 78b-1t1c-ethip6-ip6scale20k | 23.7 +- 5.56 | 25.2 +- 3.19 | 25.4 +- 3.13 | +0.79 +- 17.82 | | 64b-1t1c-af-xdp-eth-l2xcbase | 14.8 +- 0.42 | 17.3 +- 0.82 | 17.4 +- 1.26 | +0.58 +- 8.74 | | 64b-1t1c-af-xdp-ethip4-ip4base | 15.3 +- 0.48 | 17.9 +- 1.1 | 17.9 +- 1.45 | +0.0 +- 10.17 | | 78b-1t1c-af-xdp-ethip6-ip6scale200k | 15.3 +- 0.67 | 19.6 +- 1.35 | 19.6 +- 1.51 | +0.0 +- 10.32 | | 64b-1t1c-af-xdp-eth-l2bdbasemaclrn | 15.7 +- 1.16 | 18.4 +- 3.41 | 18.3 +- 1.49 | -0.54 +- 20.12 | | 64b-1t1c-ethip4-ip4base | 24.0 +- 2.58 | 26.2 +- 3.65 | 25.7 +- 4.32 | -1.91 +- 21.41 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 33.1 +- 7.22 | 36.0 +- 5.58 | 35.1 +- 7.05 | -2.5 +- 24.73 | | 64b-1t1c-af-xdp-eth-l2bdscale100kmaclrn | 15.1 +- 0.32 | 18.1 +- 0.99 | 17.6 +- 0.52 | -2.76 +- 6.06 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 29.5 +- 5.66 | 34.6 +- 9.85 | 33.5 +- 13.19 | -3.18 +- 47.04 | | 64b-1t1c-ethip4-ip4scale20k | 22.1 +- 2.38 | 26.7 +- 2.71 | 25.7 +- 5.14 | -3.75 +- 21.6 | | 78b-1t1c-ethip6-ip6scale200k | 24.9 +- 9.75 | 28.6 +- 6.67 | 27.2 +- 5.55 | -4.9 +- 29.48 | | 64b-1t1c-af-xdp-ethip4-ip4scale20k | 15.1 +- 0.32 | 21.7 +- 7.24 | 20.6 +- 5.34 | -5.07 +- 40.11 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 28.7 +- 5.66 | 34.8 +- 4.87 | 33.0 +- 5.56 | -5.17 +- 20.77 | | 64b-1t1c-ethip4-ip4scale200k | 23.0 +- 2.49 | 26.0 +- 2.31 | 24.1 +- 1.73 | -7.31 +- 10.58 | | 64b-1t1c-ethip4ipsec100spe-ip4base-policy-outbound-nocrypto | 45.9 +- 8.06 | 54.0 +- 5.56 | 49.4 +- 10.15 | -8.52 +- 21.02 | | 64b-1t1c-ethip4ipsec1000spe-ip4base-policy-outbound-nocrypto | 109.0 +- 18.62 | 91.6 +- 19.32 | 83.3 +- 28.37 | -9.06 +- 36.43 | | 78b-1t1c-ethip6-ip6base-iacldstbase | 26.3 +- 3.33 | 32.8 +- 6.84 | 29.2 +- 6.78 | -10.98 +- 27.79 | | 64b-1t1c-ethip4-ip4base-iacldstbase | 25.4 +- 3.06 | 29.9 +- 4.65 | 26.2 +- 3.22 | -12.37 +- 17.39 | | 64b-1t1c-eth-l2bdbasemaclrn | 22.2 +- 7.38 | 26.4 +- 4.3 | 22.8 +- 2.57 | -13.64 +- 17.11 | | 64b-1t1c-eth-l2xcbase-eth-2memif-1dcr | 29.6 +- 3.66 | 36.9 +- 7.31 | 31.8 +- 8.05 | -13.82 +- 27.71 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 32.5 +- 7.07 | 40.6 +- 3.86 | 34.7 +- 3.09 | -14.53 +- 11.15 | | 64b-1t1c-eth-l2xcbase | 22.5 +- 2.27 | 25.4 +- 5.21 | 21.6 +- 2.8 | -14.96 +- 20.63 | | 64b-1t1c-ethip4ipsec1spe-ip4base-policy-outbound-nocrypto | 28.3 +- 3.37 | 32.4 +- 10.33 | 23.4 +- 11.31 | -27.78 +- 41.81 | +--------------------------------------------------------------------+----------------+---------------+---------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210 and rls2302). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2302.0-11 vs 2210.0-11: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.