+--------------------------------------------------------------+---------------+---------------+---------------+------------------------+
| Test Case                                                    |     2206.0-10 |     2210.0-11 |     2302.0-11 | 2302.0-11 vs 2210.0-11 |
+--------------------------------------------------------------+---------------+---------------+---------------+------------------------+
| 64b-4t2c-avf-ethip4udp-nat44det-h16384-p63-s1032192          | 15.86 +- 0.63 | 15.74 +- 0.36 | 16.63 +- 0.86 |         +5.62 +-  5.99 |
| 100b-4t2c-avf-ethip4udp-nat44ed-h1024-p63-s64512-tput        |  9.13 +- 0.36 |  8.46 +- 1.55 |   8.9 +- 0.82 |         +5.27 +- 21.56 |
| 78b-4t2c-af-xdp-ethip6-ip6scale20k                           |  0.53 +- 0.25 |  1.97 +-  0.1 |  2.02 +-  0.0 |         +2.82 +-  5.29 |
| 78b-4t2c-af-xdp-ethip6-ip6scale20k-rnd                       |  0.78 +- 0.21 |  1.95 +- 0.07 |  1.99 +- 0.01 |         +2.04 +-  3.54 |
| 64b-4t2c-af-xdp-ethip4-ip4scale20k-rnd                       |  0.56 +- 0.38 |  1.94 +- 0.07 |  1.98 +- 0.05 |         +2.03 +-  4.62 |
| 64b-4t2c-eth-l2bdscale1mmaclrn                               | 28.85 +- 0.54 | 29.18 +- 0.31 | 29.64 +- 0.32 |          +1.6 +-  1.54 |
| 64b-4t2c-avf-ethip4udp-ip4base-iacl50sl-10kflows             | 16.64 +- 0.86 | 17.74 +- 0.34 | 18.01 +- 0.39 |          +1.5 +-  2.93 |
| 78b-4t2c-avf-ethip6-ip6scale200k                             | 24.81 +- 0.33 | 24.15 +- 0.26 | 24.47 +- 0.58 |         +1.33 +-  2.63 |
| 64b-4t2c-avf-eth-l2bdscale1mmaclrn                           | 33.67 +- 0.54 | 34.26 +- 0.39 | 34.61 +- 0.48 |         +1.03 +-  1.81 |
| 64b-4t2c-af-xdp-ethip4-ip4base                               |  0.49 +- 0.22 |  1.97 +- 0.06 |  1.99 +-  0.0 |         +1.01 +-  2.84 |
| 64b-4t2c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir         | 15.52 +- 0.19 | 15.67 +- 0.18 | 15.82 +- 0.17 |         +0.98 +-  1.62 |
| 64b-4t2c-avf-ethip4udp-ip4base-oacl50sf-10kflows             | 27.11 +-  0.2 | 28.38 +- 0.14 | 28.65 +- 0.17 |         +0.94 +-  0.76 |
| 78b-4t2c-ethip6-ip6scale20k-rnd                              | 29.35 +- 0.23 | 29.55 +- 0.28 | 29.83 +- 0.38 |         +0.93 +-   1.6 |
| 78b-4t2c-ethip6-ip6scale20k                                  | 29.12 +- 0.27 | 29.34 +- 0.35 |  29.6 +- 0.34 |         +0.91 +-  1.67 |
| 64b-4t2c-af-xdp-ethip4-ip4scale20k                           |   0.5 +- 0.23 |  1.99 +- 0.06 |   2.0 +- 0.05 |         +0.85 +-  3.81 |
| 100b-4t2c-avf-ethip4udp-nat44ed-h16384-p63-s1032192-tput     |  8.75 +- 0.19 |   8.6 +-  0.2 |  8.67 +- 0.34 |         +0.83 +-   4.6 |
| 64b-4t2c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 16.09 +- 0.69 |  16.6 +- 0.15 | 16.73 +-  0.1 |         +0.78 +-  1.12 |
| 64b-4t2c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc       |  21.1 +- 1.54 | 21.94 +- 0.33 | 22.08 +- 0.21 |         +0.65 +-  1.78 |
| 64b-4t2c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm               | 21.51 +- 0.26 | 21.91 +- 0.27 | 22.02 +- 0.41 |          +0.5 +-  2.25 |
| 64b-4t2c-avf-ethip4udp-ip4base-iacl50sf-10kflows             | 27.82 +- 0.17 | 29.19 +- 0.11 | 29.33 +- 0.13 |         +0.46 +-  0.58 |
| 64b-4t2c-eth-l2bdscale10kmaclrn                              | 34.41 +-  0.3 | 35.03 +- 0.31 | 35.17 +- 0.44 |         +0.42 +-  1.54 |
| 100b-4t2c-avf-ethip4tcp-nat44ed-h65536-p63-s4128768-tput     |  8.15 +- 0.19 |   7.7 +- 0.48 |  7.72 +- 0.27 |         +0.36 +-  7.17 |
| 78b-4t2c-avf-ethip6-ip6scale200k-rnd                         | 26.62 +- 0.36 | 26.24 +-  0.4 | 26.31 +- 1.17 |         +0.26 +-   4.7 |
| 64b-4t2c-eth-l2bdscale100kmaclrn                             | 32.58 +-  0.4 | 33.07 +- 0.39 | 33.15 +- 0.49 |         +0.23 +-   1.9 |
| 64b-4t2c-eth-l2bdbasemaclrn                                  | 35.15 +-  0.1 | 35.31 +- 0.08 | 35.38 +- 0.07 |         +0.21 +-   0.3 |
| 64b-4t2c-ethip4-ip4base-eth-2memif-1dcr                      | 17.86 +- 0.18 | 18.13 +- 0.11 | 18.17 +- 0.15 |         +0.21 +-  1.03 |
| 64b-4t2c-ethip4-ip4scale20k-rnd                              | 35.95 +- 0.32 | 36.85 +- 0.24 | 36.92 +- 0.23 |          +0.2 +-   0.9 |
| 78b-4t2c-avf-ethip6-ip6scale2m-rnd                           | 18.15 +-  0.2 | 18.01 +- 0.24 | 18.05 +- 0.16 |         +0.19 +-  1.59 |
| 64b-4t2c-avf-ethip4udp-nat44det-h1024-p63-s64512             |  8.57 +- 0.06 |  8.62 +- 0.06 |  8.64 +- 0.07 |         +0.16 +-  1.02 |
| 64b-4t2c-avf-dot1q-l2bdbasemaclrn                            | 31.42 +- 0.11 | 32.15 +- 0.18 |  32.2 +-  0.1 |         +0.14 +-  0.64 |
| 64b-4t2c-avf-ethip4udp-nat44ed-h65536-p63-s4128768-cps       |  1.47 +- 0.01 |  1.45 +- 0.09 |  1.45 +- 0.03 |         +0.11 +-  6.69 |
| 64b-4t2c-avf-ethip4udp-ip4base-oacl50sl-10kflows             | 16.73 +- 0.38 | 17.78 +-  0.3 |  17.8 +- 0.61 |         +0.11 +-  3.84 |
| 78b-4t2c-avf-ethip6-ip6scale2m                               | 20.02 +- 0.99 | 20.19 +- 0.66 |  20.2 +- 0.33 |         +0.06 +-  3.67 |
| 64b-4t2c-eth-l2bdbasemaclrn-eth-2memif-1dcr                  | 19.28 +- 0.23 | 19.47 +- 0.27 | 19.48 +-  0.2 |         +0.05 +-  1.71 |
| 100b-4t2c-avf-ethip4tcp-nat44ed-h1024-p63-s64512-tput        |   8.9 +- 0.31 |  8.74 +- 0.24 |  8.75 +- 0.29 |         +0.04 +-  4.31 |
| 64b-4t2c-avf-ethip4-ip4base                                  | 36.44 +- 0.34 |  36.5 +- 0.07 | 36.51 +- 0.08 |         +0.04 +-  0.28 |
| 64b-4t2c-avf-eth-l2bdscale10kmaclrn                          | 36.41 +-  0.1 | 36.39 +- 0.03 | 36.39 +- 0.02 |          +0.0 +-  0.11 |
| 64b-4t2c-avf-eth-l2bdbasemaclrn                              |  36.3 +- 0.35 | 36.43 +- 0.07 | 36.43 +- 0.05 |          +0.0 +-  0.23 |
| 64b-4t2c-avf-eth-l2bdscale100kmaclrn                         | 37.28 +- 0.19 | 37.31 +- 0.09 | 37.31 +- 0.08 |          -0.0 +-  0.32 |
| 64b-4t2c-avf-ethip4-ip4scale200k                             | 36.55 +- 0.25 | 36.48 +- 0.09 | 36.48 +- 0.09 |         -0.01 +-  0.35 |
| 64b-4t2c-avf-ethip4-ip4scale200k-rnd                         | 36.66 +-  0.2 | 36.62 +- 0.07 | 36.61 +- 0.06 |         -0.03 +-  0.25 |
| 64b-4t2c-avf-ethip4-ip4scale20k-rnd                          | 36.48 +- 0.17 | 36.53 +- 0.08 | 36.51 +- 0.07 |         -0.03 +-  0.28 |
| 64b-4t2c-avf-eth-l2patch                                     | 30.77 +- 0.12 | 30.62 +- 0.08 |  30.6 +- 0.06 |         -0.07 +-  0.34 |
| 64b-4t2c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm         | 16.39 +- 0.14 | 16.84 +- 0.17 | 16.83 +- 0.16 |         -0.09 +-   1.4 |
| 64b-4t2c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr              | 22.32 +- 0.15 | 22.72 +- 0.13 | 22.69 +- 0.19 |         -0.13 +-  1.02 |
| 64b-4t2c-avf-ethip4-ip4scale20k                              |  36.4 +-  0.3 |  36.5 +- 0.07 | 36.44 +- 0.06 |         -0.16 +-  0.26 |
| 64b-4t2c-avf-ethip4-ip4scale2m-rnd                           | 30.93 +- 1.67 | 32.41 +- 0.27 | 32.35 +- 0.47 |         -0.19 +-  1.67 |
| 78b-4t2c-ethip6-ip6base                                      | 34.48 +-  0.2 | 35.15 +- 0.13 | 35.08 +- 0.36 |          -0.2 +-  1.08 |
| 64b-4t2c-avf-eth-l2xcbase-eth-2memif-1dcr                    | 32.51 +- 0.26 | 32.64 +-  0.2 | 32.56 +- 0.33 |         -0.25 +-  1.17 |
| 64b-4t2c-ethip4-ip4base                                      | 35.99 +- 0.16 | 35.26 +- 0.13 | 35.15 +- 0.09 |         -0.29 +-  0.45 |
| 64b-4t2c-avf-ethip4tcp-nat44ed-h16384-p63-s1032192-cps       |  1.05 +- 0.01 |  1.05 +- 0.01 |  1.04 +- 0.01 |         -0.34 +-  0.74 |
| 64b-4t2c-eth-l2xcbase                                        |  35.3 +-  0.1 | 35.02 +- 0.09 | 34.89 +-  0.1 |         -0.37 +-  0.38 |
| 100b-4t2c-avf-ethip4udp-nat44ed-h65536-p63-s4128768-tput     |  8.59 +- 0.44 |  8.81 +-  0.2 |  8.77 +- 0.19 |         -0.37 +-  3.09 |
| 64b-4t2c-ethip4-ip4scale20k                                  | 35.32 +- 0.35 | 36.59 +- 0.29 | 36.45 +- 0.47 |         -0.38 +-  1.51 |
| 64b-4t2c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc     | 14.43 +- 0.56 |  14.9 +- 0.14 | 14.84 +- 0.09 |         -0.39 +-  1.09 |
| 64b-4t2c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm             | 14.36 +- 0.17 | 14.62 +- 0.28 | 14.56 +- 0.23 |         -0.42 +-  2.46 |
| 64b-4t2c-avf-eth-l2xcbase                                    | 34.11 +- 0.23 | 34.18 +- 0.06 | 34.03 +- 0.05 |         -0.44 +-  0.22 |
| 64b-4t2c-avf-ethip4tcp-nat44ed-h1024-p63-s64512-cps          |   1.3 +- 0.01 |  1.31 +- 0.01 |   1.3 +- 0.01 |         -0.45 +-  1.12 |
| 64b-4t2c-avf-ethip4udp-nat44det-h65536-p63-s4128758          | 12.83 +- 0.17 | 12.97 +- 0.14 | 12.91 +- 0.17 |         -0.48 +-  1.71 |
| 78b-4t2c-af-xdp-ethip6-ip6base                               |  0.57 +- 0.26 |  1.98 +- 0.03 |  1.97 +- 0.06 |         -0.53 +-  3.27 |
| 64b-4t2c-avf-ethip4tcp-nat44ed-h65536-p63-s4128768-cps       |  0.97 +- 0.01 |  0.97 +- 0.01 |  0.96 +-  0.0 |          -0.6 +-   0.7 |
| 64b-4t2c-avf-ethip4-ip4scale2m                               | 35.11 +- 0.41 | 35.41 +- 0.64 | 35.19 +- 0.74 |         -0.64 +-  2.76 |
| 64b-4t2c-avf-ethip4-ip4base-eth-2memif-1dcr                  | 21.19 +-  0.4 | 21.56 +- 0.34 |  21.4 +- 0.47 |         -0.73 +-  2.68 |
| 100b-4t2c-avf-ethip4tcp-nat44ed-h16384-p63-s1032192-tput     |  8.33 +- 0.18 |   7.7 +- 0.33 |  7.63 +- 0.28 |         -0.86 +-  5.59 |
| 64b-4t2c-avf-ethip4--ethip4udpgeneve-256tun-ip4base          | 17.82 +-  0.1 | 18.05 +-  0.1 | 17.89 +- 0.27 |         -0.89 +-   1.6 |
| 64b-4t2c-avf-ethip4--ethip4udpgeneve-16tun-ip4base           |  18.3 +-  0.1 | 18.53 +- 0.06 | 18.36 +- 0.26 |          -0.9 +-  1.42 |
| 64b-4t2c-eth-l2xcbase-eth-2memif-1dcr                        | 27.07 +- 0.34 | 27.68 +- 0.33 | 27.42 +- 0.44 |         -0.94 +-  1.98 |
| 64b-4t2c-avf-ethip4--ethip4udpgeneve-4tun-ip4base            | 18.61 +- 0.07 | 18.78 +- 0.06 | 18.58 +- 0.36 |         -1.06 +-  1.92 |
| 64b-4t2c-eth-l2patch                                         | 32.09 +- 0.13 | 32.08 +-  0.1 | 31.72 +- 0.11 |         -1.11 +-  0.45 |
| 64b-4t2c-avf-ethip4--ethip4udpgeneve-64tun-ip4base           | 18.06 +- 0.07 | 18.33 +-  0.1 | 18.03 +- 0.33 |         -1.65 +-  1.85 |
| 64b-4t2c-avf-ethip4--ethip4udpgeneve-1tun-ip4base            | 20.88 +- 0.12 | 21.03 +- 0.08 | 20.62 +- 0.59 |         -1.96 +-  2.84 |
| 78b-4t2c-avf-ethip6-ip6scale20k                              | 32.69 +- 0.33 | 33.44 +- 0.39 |  32.7 +- 2.73 |          -2.2 +-  8.25 |
| 78b-4t2c-avf-ethip6-ip6scale20k-rnd                          | 33.81 +- 0.28 | 34.34 +- 0.25 | 33.51 +- 3.01 |         -2.42 +-  8.79 |
| 78b-4t2c-avf-ethip6-ip6base                                  | 37.03 +- 0.13 | 36.94 +- 0.08 | 35.92 +- 3.48 |         -2.76 +-  9.43 |
| 64b-4t2c-avf-ethip4udp-nat44ed-h1024-p63-s64512-cps          |  2.16 +-  0.7 |  2.41 +- 0.02 |  2.18 +- 0.64 |         -9.41 +- 26.78 |
| 64b-4t2c-avf-ethip4udp-nat44ed-h16384-p63-s1032192-cps       |  1.63 +- 0.11 |  1.62 +- 0.11 |  1.46 +- 0.49 |         -9.87 +- 30.84 |
+--------------------------------------------------------------+---------------+---------------+---------------+------------------------+

Test Case:              Test cases executed for: NDR throughput on 2n-icx with xxv710.
YYMM.V-E:               [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210 and rls2302).
YYMM.V-E vs YYMM.V-E:   [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below.
2302.0-11 vs 2210.0-11: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.