+--------------------------------------------------------------------+----------------+----------------+----------------+------------------------+ | Test Case | 2206.0-10 | 2210.0-11 | 2302.0-11 | 2302.0-11 vs 2210.0-11 | +--------------------------------------------------------------------+----------------+----------------+----------------+------------------------+ | 78b-1t1c-af-xdp-ethip6-ip6scale20k | 17.7 +- 1.06 | 22.0 +- 4.52 | 27.4 +- 8.24 | +24.55 +- 45.35 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 74.9 +- 5.93 | 67.4 +- 9.67 | 81.8 +- 8.4 | +21.36 +- 21.42 | | 64b-1t1c-ethip4-ip4base-iacldstbase | 56.4 +- 6.17 | 82.8 +- 20.51 | 94.5 +- 17.76 | +14.13 +- 35.49 | | 64b-1t1c-af-xdp-eth-l2patch | 15.6 +- 0.7 | 20.0 +- 5.29 | 22.5 +- 8.15 | +12.5 +- 50.48 | | 64b-1t1c-af-xdp-ethip4-ip4scale200k | 16.7 +- 0.95 | 21.8 +- 5.33 | 24.3 +- 6.63 | +11.47 +- 40.85 | | 78b-1t1c-af-xdp-ethip6-ip6base | 17.4 +- 0.97 | 21.1 +- 4.95 | 23.3 +- 7.47 | +10.43 +- 43.88 | | 64b-1t1c-ethip4-ip4scale200k | 45.0 +- 6.75 | 54.7 +- 3.95 | 60.4 +- 5.52 | +10.42 +- 12.86 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 61.4 +- 5.64 | 76.8 +- 5.9 | 84.5 +- 6.88 | +10.03 +- 12.32 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 81.8 +- 9.55 | 80.9 +- 7.52 | 88.4 +- 8.72 | +9.27 +- 14.81 | | 64b-1t1c-ethip4ipsec1000spe-cache-ip4base-policy-outbound-nocrypto | 59.7 +- 5.21 | 68.9 +- 3.03 | 74.9 +- 8.57 | +8.71 +- 13.33 | | 78b-1t1c-ethip6-ip6base-iacldstbase | 48.3 +- 3.89 | 46.1 +- 7.23 | 50.1 +- 12.76 | +8.68 +- 32.51 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 66.0 +- 6.22 | 83.3 +- 4.57 | 90.0 +- 5.72 | +8.04 +- 9.07 | | 64b-1t1c-af-xdp-eth-l2bdscale10kmaclrn | 17.0 +- 1.05 | 21.7 +- 4.5 | 23.1 +- 10.76 | +6.45 +- 54.29 | | 64b-1t1c-eth-l2xcbase-eth-2memif-1dcr | 80.3 +- 21.77 | 99.7 +- 35.2 | 106.0 +- 20.45 | +6.32 +- 42.78 | | 64b-1t1c-af-xdp-ethip4-ip4base | 18.3 +- 4.85 | 21.2 +- 3.46 | 22.0 +- 6.7 | +3.77 +- 35.85 | | 64b-1t1c-ethip4-ip4base | 38.5 +- 5.04 | 49.0 +- 5.14 | 50.8 +- 8.38 | +3.67 +- 20.26 | | 64b-1t1c-af-xdp-eth-l2bdscale100kmaclrn | 16.6 +- 0.52 | 22.2 +- 4.85 | 23.0 +- 6.18 | +3.6 +- 35.88 | | 64b-1t1c-eth-l2patch | 23.4 +- 4.09 | 28.0 +- 3.89 | 28.9 +- 2.85 | +3.21 +- 17.57 | | 64b-1t1c-af-xdp-eth-l2bdbasemaclrn | 16.5 +- 0.53 | 22.1 +- 7.03 | 22.8 +- 7.27 | +3.17 +- 46.47 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 67.1 +- 5.61 | 85.6 +- 7.09 | 87.3 +- 6.53 | +1.99 +- 11.38 | | 64b-1t1c-ethip4-ip4scale20k | 42.6 +- 4.84 | 51.3 +- 4.97 | 52.2 +- 3.26 | +1.75 +- 11.72 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 65.3 +- 15.51 | 83.5 +- 4.7 | 84.8 +- 4.98 | +1.56 +- 8.26 | | 64b-1t1c-ethip4ipsec100spe-cache-ip4base-policy-outbound-nocrypto | 61.7 +- 3.43 | 72.1 +- 4.77 | 73.1 +- 9.12 | +1.39 +- 14.32 | | 64b-1t1c-ethip4ipsec100spe-ip4base-policy-outbound-nocrypto | 96.5 +- 13.8 | 133.0 +- 20.11 | 133.3 +- 18.87 | +0.23 +- 20.76 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 78.8 +- 17.52 | 69.6 +- 4.9 | 69.5 +- 9.59 | -0.14 +- 15.48 | | 64b-1t1c-ethip4-ip4base-eth-2memif-1dcr | 137.5 +- 48.12 | 262.7 +- 29.43 | 262.3 +- 16.3 | -0.15 +- 12.79 | | 64b-1t1c-af-xdp-eth-l2xcbase | 16.4 +- 0.52 | 20.7 +- 4.67 | 20.5 +- 5.54 | -0.97 +- 34.87 | | 64b-1t1c-ethip4ipsec1spe-cache-ip4base-policy-outbound-nocrypto | 53.2 +- 6.12 | 71.2 +- 6.76 | 70.0 +- 7.94 | -1.69 +- 14.55 | | 78b-1t1c-ethip6-ip6base | 36.5 +- 5.23 | 47.3 +- 4.67 | 46.0 +- 3.89 | -2.75 +- 12.64 | | 64b-1t1c-eth-l2xcbase | 36.6 +- 4.12 | 37.7 +- 3.77 | 36.4 +- 4.14 | -3.45 +- 14.63 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 59.4 +- 5.4 | 81.5 +- 3.41 | 78.3 +- 6.75 | -3.93 +- 9.21 | | 64b-1t1c-ethip4ipsec1spe-ip4base-policy-outbound-nocrypto | 81.5 +- 12.09 | 65.5 +- 5.32 | 62.6 +- 5.48 | -4.43 +- 11.41 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 76.2 +- 5.45 | 112.5 +- 34.79 | 107.5 +- 18.36 | -4.44 +- 33.76 | | 78b-1t1c-ethip6-ip6scale200k | 49.7 +- 7.24 | 58.5 +- 6.65 | 55.9 +- 10.14 | -4.44 +- 20.46 | | 64b-1t1c-af-xdp-ethip4-ip4scale20k | 17.0 +- 2.21 | 28.1 +- 11.04 | 26.6 +- 8.25 | -5.34 +- 47.38 | | 78b-1t1c-af-xdp-ethip6-ip6scale200k | 17.0 +- 1.05 | 21.1 +- 5.63 | 19.8 +- 0.63 | -6.16 +- 25.2 | | 64b-1t1c-eth-l2bdscale10kmaclrn | 47.2 +- 5.07 | 55.7 +- 5.12 | 52.1 +- 5.8 | -6.46 +- 13.51 | | 78b-1t1c-ethip6-ip6scale20k | 47.1 +- 2.13 | 67.1 +- 13.7 | 61.8 +- 12.19 | -7.9 +- 26.15 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 51.1 +- 4.75 | 76.9 +- 12.42 | 70.8 +- 8.82 | -7.93 +- 18.78 | | 64b-1t1c-ethip4ipsec1000spe-ip4base-policy-outbound-nocrypto | 398.1 +- 14.8 | 386.0 +- 29.2 | 353.0 +- 73.1 | -8.55 +- 20.16 | | 64b-1t1c-eth-l2bdscale100kmaclrn | 49.0 +- 5.42 | 57.2 +- 4.73 | 51.7 +- 3.62 | -9.62 +- 9.8 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 67.4 +- 9.14 | 102.6 +- 17.13 | 91.1 +- 9.93 | -11.21 +- 17.7 | | 64b-1t1c-eth-l2bdbasemaclrn | 45.8 +- 3.08 | 55.4 +- 6.2 | 47.3 +- 5.79 | -14.62 +- 14.17 | +--------------------------------------------------------------------+----------------+----------------+----------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210 and rls2302). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2302.0-11 vs 2210.0-11: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.