+---------------------------------------------------------------+---------------+---------------+---------------+---------------+----------------------+----------------------+ | Test Case | 2106.0-8 | 2110.0-8 | 2110.0-9 | 2202.0-9 | 2110.0-9 vs 2110.0-8 | 2202.0-9 vs 2110.0-9 | +---------------------------------------------------------------+---------------+---------------+---------------+---------------+----------------------+----------------------+ | 64b-2t1c-rdma-ethip4udp-ip4base-iacl50sl-10kflows | 8.75 +- 0.02 | 8.53 +- 0.01 | 8.54 +- 0.01 | 9.08 +- 0.14 | +0.07 +- 0.13 | +6.37 +- 1.59 | | 64b-2t1c-rdma-ethip4-ip4base | 17.31 +- 0.18 | 17.23 +- 0.16 | 17.34 +- 0.18 | 18.31 +- 0.18 | +0.61 +- 1.38 | +5.62 +- 1.5 | | 64b-2t1c-rdma-ethip4-ip4scale20k-rnd | 15.43 +- 0.1 | 15.43 +- 0.15 | 15.49 +- 0.14 | 16.34 +- 0.09 | +0.4 +- 1.34 | +5.45 +- 1.1 | | 64b-2t1c-rdma-ethip4udp-ip4base-oacl50sf-10kflows | 9.95 +- 0.02 | 10.01 +- 0.21 | 9.83 +- 0.01 | 10.3 +- 0.02 | -1.78 +- 2.08 | +4.74 +- 0.24 | | 64b-2t1c-rdma-ethip4-ip4scale20k | 15.74 +- 0.16 | 15.35 +- 0.12 | 15.61 +- 0.14 | 16.33 +- 0.1 | +1.71 +- 1.21 | +4.62 +- 1.14 | | 64b-2t1c-rdma-ethip4udp-ip4base-iacl50sf-10kflows | 10.28 +- 0.01 | 10.06 +- 0.02 | 10.06 +- 0.01 | 10.52 +- 0.01 | +0.01 +- 0.21 | +4.55 +- 0.19 | | 78b-2t1c-rdma-ethip6-ip6scale20k | 13.37 +- 0.54 | 13.83 +- 0.07 | 13.76 +- 0.04 | 14.15 +- 0.06 | -0.49 +- 0.57 | +2.8 +- 0.55 | | 78b-2t1c-rdma-ethip6-ip6scale20k-rnd | 13.84 +- 0.38 | 13.74 +- 0.16 | 13.9 +- 0.07 | 14.24 +- 0.08 | +1.19 +- 1.29 | +2.44 +- 0.79 | | 64b-2t1c-rdma-ethip4-ip4base-eth-2memif-1dcr | 7.88 +- 0.13 | 7.84 +- 0.17 | 7.78 +- 0.1 | 7.96 +- 0.24 | -0.8 +- 2.57 | +2.36 +- 3.42 | | 64b-2t1c-rdma-eth-l2bdscale1mmaclrn | 13.03 +- 0.11 | 13.01 +- 0.09 | 12.87 +- 0.15 | 13.04 +- 0.09 | -1.08 +- 1.34 | +1.36 +- 1.4 | | 64b-2t1c-rdma-eth-l2bdscale10kmaclrn | 16.19 +- 0.32 | 15.79 +- 0.42 | 16.26 +- 0.63 | 16.44 +- 0.04 | +2.99 +- 4.83 | +1.08 +- 3.92 | | 64b-2t1c-rdma-ethip4udp-ip4base-oacl50sl-10kflows | 8.53 +- 0.16 | 8.46 +- 0.16 | 8.43 +- 0.14 | 8.51 +- 0.02 | -0.38 +- 2.58 | +0.89 +- 1.74 | | 64b-2t1c-rdma-eth-l2patch | 37.86 +- 0.05 | 37.86 +- 0.02 | 37.88 +- 0.08 | 38.02 +- 0.03 | +0.04 +- 0.21 | +0.36 +- 0.23 | | 64b-2t1c-rdma-eth-l2bdscale100kmaclrn | 14.92 +- 0.25 | 15.3 +- 0.32 | 15.34 +- 0.11 | 15.18 +- 0.07 | +0.25 +- 2.19 | -1.06 +- 0.85 | | 78b-2t1c-rdma-ethip6-ip6base | 16.16 +- 0.46 | 17.19 +- 0.11 | 17.12 +- 0.25 | 16.75 +- 0.23 | -0.4 +- 1.61 | -2.18 +- 1.97 | | 64b-2t1c-rdma-eth-l2xcbase | 29.31 +- 0.2 | 30.08 +- 0.24 | 30.52 +- 0.08 | 29.76 +- 0.28 | +1.47 +- 0.87 | -2.5 +- 0.94 | | 64b-2t1c-rdma-eth-l2xcbase-eth-2memif-1dcr | 13.88 +- 0.17 | 13.71 +- 0.19 | 13.56 +- 0.08 | 13.22 +- 0.3 | -1.05 +- 1.51 | -2.51 +- 2.25 | | 64b-2t1c-rdma-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 7.72 +- 0.14 | 7.38 +- 0.22 | 7.18 +- 0.04 | 6.83 +- 0.03 | -2.77 +- 2.93 | -4.85 +- 0.74 | | 64b-2t1c-rdma-dot1q-l2bdbasemaclrn | 12.9 +- 0.37 | 13.12 +- 0.3 | 13.06 +- 0.34 | 12.38 +- 0.2 | -0.47 +- 3.43 | -5.21 +- 2.88 | | 64b-2t1c-rdma-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 7.66 +- 0.11 | 7.3 +- 0.19 | 7.45 +- 0.18 | 6.93 +- 0.19 | +1.95 +- 3.59 | -6.92 +- 3.35 | | 64b-2t1c-rdma-eth-l2bdbasemaclrn | 21.01 +- 0.55 | 21.1 +- 0.11 | 21.2 +- 0.15 | 19.65 +- 0.35 | +0.49 +- 0.89 | -7.34 +- 1.79 | | 64b-2t1c-rdma-eth-l2bdbasemaclrn-eth-2memif-1dcr | 9.87 +- 0.15 | 9.61 +- 0.1 | 9.62 +- 0.1 | 8.86 +- 0.06 | +0.16 +- 1.5 | -7.96 +- 1.19 | +---------------------------------------------------------------+---------------+---------------+---------------+---------------+----------------------+----------------------+ Test Case: Test cases executed for: MRR throughput on 2n-clx with cx556a. YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "8" for CSIT rls2110, "9" for CSIT rls2202). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2110.0-9 vs 2110.0-8: Compares CSIT environment current vs previous with previous VPP code. 2202.0-9 vs 2110.0-9: Compares VPP code current vs previous in the current CSIT environment.