+-----------------------------------------------------+--------------+--------------+-------------+----------------------+----------------------+ | Test Case | 2101.0-6 | 2101.0-7 | 2106.0-7 | 2101.0-7 vs 2101.0-6 | 2106.0-7 vs 2101.0-7 | +-----------------------------------------------------+--------------+--------------+-------------+----------------------+----------------------+ | 64b-1t1c-eth-l2bdscale1mmaclrn | 23.0 +- 1.6 | 23.0 +- 1.6 | 27.0 +- NaN | +0.0 +- 10.0 | +17.4 +- NaN | | 64b-1t1c-ethip4-ip4scale20k | 19.0 +- 3.3 | 19.0 +- 3.3 | 22.0 +- NaN | +0.0 +- 24.6 | +15.8 +- NaN | | 64b-1t1c-eth-l2bdscale10kmaclrn | 23.0 +- 2.1 | 23.0 +- 2.1 | 26.0 +- NaN | +0.0 +- 13.0 | +13.0 +- NaN | | 64b-1t1c-eth-l2bdscale100kmaclrn | 23.6 +- 2.2 | 23.6 +- 2.2 | 26.0 +- NaN | +0.0 +- 13.3 | +10.2 +- NaN | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 22.2 +- 2.4 | 22.2 +- 2.4 | 24.0 +- NaN | +0.0 +- 15.5 | +8.1 +- NaN | | 64b-1t1c-dot1q-l2bdbasemaclrn | 22.3 +- 1.5 | 22.3 +- 1.5 | 24.0 +- NaN | +0.0 +- 9.5 | +7.6 +- NaN | | 64b-1t1c-ethip4-ip4base-iacldstbase | 22.5 +- 2.2 | 22.5 +- 2.2 | 24.0 +- NaN | +0.0 +- 14.0 | +6.7 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 24.5 +- 1.4 | 24.5 +- 1.4 | 26.0 +- NaN | +0.0 +- 8.3 | +6.1 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn | 20.2 +- 1.3 | 20.2 +- 1.3 | 21.0 +- NaN | +0.0 +- 9.2 | +4.0 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 23.3 +- 2.0 | 23.3 +- 2.0 | 24.0 +- NaN | +0.0 +- 12.2 | +3.0 +- NaN | | 78b-1t1c-ethip6-ip6scale20k | 21.5 +- 1.5 | 21.5 +- 1.5 | 22.0 +- NaN | +0.0 +- 9.9 | +2.3 +- NaN | | 78b-1t1c-ethip6-ip6base-iacldstbase | 21.6 +- 2.7 | 21.6 +- 2.7 | 22.0 +- NaN | +0.0 +- 17.4 | +2.1 +- NaN | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 21.1 +- 2.1 | 21.1 +- 2.1 | 21.0 +- NaN | +0.0 +- 14.0 | -0.5 +- NaN | | 64b-1t1c-eth-l2patch | 15.1 +- 1.1 | 15.1 +- 1.1 | 15.0 +- NaN | +0.0 +- 9.9 | -0.7 +- NaN | | 78b-1t1c-ethip6-ip6scale2m | 21.6 +- 2.3 | 21.6 +- 2.3 | 21.0 +- NaN | +0.0 +- 15.2 | -2.8 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 29.1 +- 3.2 | 29.1 +- 3.2 | 28.0 +- NaN | +0.0 +- 15.6 | -3.8 +- NaN | | 64b-1t1c-ethip4-ip4scale200k | 22.3 +- 1.9 | 22.3 +- 1.9 | 21.0 +- NaN | +0.0 +- 12.0 | -5.8 +- NaN | | 78b-1t1c-ethip6-ip6scale200k | 21.7 +- 2.8 | 21.7 +- 2.8 | 20.0 +- NaN | +0.0 +- 18.2 | -7.8 +- NaN | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 27.5 +- 2.9 | 27.5 +- 2.9 | 25.0 +- NaN | +0.0 +- 14.8 | -9.1 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 26.9 +- 4.4 | 26.9 +- 4.4 | 24.0 +- NaN | +0.0 +- 22.9 | -10.8 +- NaN | | 64b-1t1c-ethip4-ip4scale2m | 22.6 +- 3.0 | 22.6 +- 3.0 | 20.0 +- NaN | +0.0 +- 18.5 | -11.5 +- NaN | | 64b-1t1c-eth-l2xcbase | 18.1 +- 1.7 | 18.1 +- 1.7 | 16.0 +- NaN | +0.0 +- 13.5 | -11.6 +- NaN | | 64b-1t1c-ethip4-ip4base | 20.9 +- 2.1 | 20.9 +- 2.1 | 18.0 +- NaN | +0.0 +- 14.1 | -13.9 +- NaN | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 27.7 +- 5.5 | 27.7 +- 5.5 | 21.0 +- NaN | +0.0 +- 28.1 | -24.2 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 36.0 +- 13.5 | 36.0 +- 13.5 | 24.0 +- NaN | +0.0 +- 53.2 | -33.3 +- NaN | | 78b-1t1c-ethip6-ip6base | 21.4 +- 2.0 | 21.4 +- 2.0 | 14.0 +- NaN | +0.0 +- 13.3 | -34.6 +- NaN | +-----------------------------------------------------+--------------+--------------+-------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "6" for CSIT rls2101, "7" for CSIT rls2106). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2101.0-7 vs 2101.0-6: Compares CSIT environment current vs previous with previous VPP code. 2106.0-7 vs 2101.0-7: Compares VPP code current vs previous in the current CSIT environment.