+-----------------------------------------------------+----------------+----------------+---------------+----------------------+----------------------+ | Test Case | 2101.0-6 | 2101.0-7 | 2106.0-7 | 2101.0-7 vs 2101.0-6 | 2106.0-7 vs 2101.0-7 | +-----------------------------------------------------+----------------+----------------+---------------+----------------------+----------------------+ | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 278.2 +- 443.9 | 278.2 +- 443.9 | 1107.0 +- NaN | +0.0 +- 225.6 | +297.9 +- NaN | | 64b-1t1c-dot1q-l2bdbasemaclrn | 117.0 +- 17.5 | 117.0 +- 17.5 | 116.0 +- NaN | +0.0 +- 21.2 | -0.9 +- NaN | | 64b-1t1c-ethip4-ip4scale200k | 116.3 +- 15.3 | 116.3 +- 15.3 | 107.0 +- NaN | +0.0 +- 18.6 | -8.0 +- NaN | | 64b-1t1c-eth-l2bdscale1mmaclrn | 131.7 +- 21.8 | 131.7 +- 21.8 | 120.0 +- NaN | +0.0 +- 23.4 | -8.9 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 146.0 +- 14.6 | 146.0 +- 14.6 | 130.0 +- NaN | +0.0 +- 14.1 | -11.0 +- NaN | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 141.8 +- 16.0 | 141.8 +- 16.0 | 125.0 +- NaN | +0.0 +- 16.0 | -11.8 +- NaN | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 123.7 +- 7.3 | 123.7 +- 7.3 | 109.0 +- NaN | +0.0 +- 8.4 | -11.9 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 143.4 +- 15.7 | 143.4 +- 15.7 | 126.0 +- NaN | +0.0 +- 15.5 | -12.1 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn | 105.2 +- 14.6 | 105.2 +- 14.6 | 92.0 +- NaN | +0.0 +- 19.7 | -12.5 +- NaN | | 64b-1t1c-eth-l2xcbase | 85.7 +- 9.3 | 85.7 +- 9.3 | 73.0 +- NaN | +0.0 +- 15.4 | -14.8 +- NaN | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 133.6 +- 19.4 | 133.6 +- 19.4 | 113.0 +- NaN | +0.0 +- 20.6 | -15.4 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 149.4 +- 23.1 | 149.4 +- 23.1 | 124.0 +- NaN | +0.0 +- 21.9 | -17.0 +- NaN | | 78b-1t1c-ethip6-ip6scale20k | 102.6 +- 15.6 | 102.6 +- 15.6 | 85.0 +- NaN | +0.0 +- 21.5 | -17.2 +- NaN | | 64b-1t1c-ethip4-ip4base | 97.7 +- 12.2 | 97.7 +- 12.2 | 77.0 +- NaN | +0.0 +- 17.6 | -21.2 +- NaN | | 64b-1t1c-eth-l2bdscale10kmaclrn | 126.0 +- 14.5 | 126.0 +- 14.5 | 92.0 +- NaN | +0.0 +- 16.3 | -27.0 +- NaN | | 78b-1t1c-ethip6-ip6base-iacldstbase | 112.3 +- 11.7 | 112.3 +- 11.7 | 81.0 +- NaN | +0.0 +- 14.8 | -27.9 +- NaN | | 78b-1t1c-ethip6-ip6scale2m | 140.2 +- 13.0 | 140.2 +- 13.0 | 100.0 +- NaN | +0.0 +- 13.1 | -28.7 +- NaN | | 78b-1t1c-ethip6-ip6base | 110.7 +- 14.6 | 110.7 +- 14.6 | 67.0 +- NaN | +0.0 +- 18.7 | -39.5 +- NaN | | 64b-1t1c-eth-l2patch | 73.0 +- 11.2 | 73.0 +- 11.2 | 42.0 +- NaN | +0.0 +- 21.7 | -42.5 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 297.6 +- 461.9 | 297.6 +- 461.9 | 143.0 +- NaN | +0.0 +- 219.5 | -51.9 +- NaN | | 64b-1t1c-ethip4-ip4scale2m | 253.4 +- 403.1 | 253.4 +- 403.1 | 110.0 +- NaN | +0.0 +- 225.0 | -56.6 +- NaN | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 287.4 +- 465.0 | 287.4 +- 465.0 | 106.0 +- NaN | +0.0 +- 228.8 | -63.1 +- NaN | | 64b-1t1c-ethip4-ip4base-iacldstbase | 292.1 +- 487.2 | 292.1 +- 487.2 | 97.0 +- NaN | +0.0 +- 235.9 | -66.8 +- NaN | | 64b-1t1c-ethip4-ip4scale20k | 240.2 +- 401.7 | 240.2 +- 401.7 | 74.0 +- NaN | +0.0 +- 236.5 | -69.2 +- NaN | | 78b-1t1c-ethip6-ip6scale200k | 338.7 +- 445.0 | 338.7 +- 445.0 | 94.0 +- NaN | +0.0 +- 185.8 | -72.2 +- NaN | | 64b-1t1c-eth-l2bdscale100kmaclrn | 501.6 +- 610.3 | 501.6 +- 610.3 | 111.0 +- NaN | +0.0 +- 172.1 | -77.9 +- NaN | +-----------------------------------------------------+----------------+----------------+---------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "6" for CSIT rls2101, "7" for CSIT rls2106). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2101.0-7 vs 2101.0-6: Compares CSIT environment current vs previous with previous VPP code. 2106.0-7 vs 2101.0-7: Compares VPP code current vs previous in the current CSIT environment.