10.11. vts

10.11.1. 10ge2p1x710-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr suite

RFC2544: Packet throughput L2BD test cases with VXLANoIPv4 and vhost

[Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes. [Enc] Packet Encapsulations: Eth-IPv4 for L2 switching of IPv4. Eth-IPv4-VXLAN-Eth-IPv4 is applied on link between DUT1 and DUT2. [Cfg] DUT configuration: DUT1 and DUT2 are configured with L2 bridge- domain and MAC learning enabled. Qemu VNFs are connected to VPP via vhost-user interfaces. Guest is running VPP l2xc interconnecting vhost-user interfaces, rxd/txd=1024. DUT1/DUT2 is tested with ${nic_name}. [Ver] TG verification: TG finds and reports throughput NDR (Non DropRate) with zero packet loss tolerance and throughput PDR (Partial DropRate) with non-zero packet loss tolerance (LT) expressed in percentageof packets transmitted. NDR and PDR are discovered for differentEthernet L2 frame sizes using MLRsearch library.Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces. [Ref] Applicable standard specifications: RFC2544, RFC7348.

# Copyright (c) 2019 Cisco and/or its affiliates.
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at:
#
#     http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
| ...
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | L2BDMACLRN | ENCAP | VXLAN | L2OVRLAY | IP4UNRLAY
| ... | VHOST | VM | VHOST_1024 | VTS | ACL_PERMIT
| ...
| Suite Setup | Setup suite single link | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test
| Test Teardown | Tear down test | performance | vhost
| ...
| Test Template | Local Template
| ...
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | acl_plugin.so
| ${osi_layer}= | L3
| ${nic_name}= | Intel-X710
| ${overhead}= | ${50}
| ${nf_dtcr}= | ${1}
| ${nf_dtc}= | ${1}
| ${nf_chains}= | ${1}
| ${nf_nodes}= | ${1}
| ${dut1_bd_id1}= | 1
| ${dut1_bd_id2}= | 2
| ${dut2_bd_id1}= | 1
# Traffic profile:
| ${traffic_profile}=
| ... | trex-sl-ethip4vxlan-ip4src${nf_chains}udpsrcrnd
| ${acl_type}= | permit

10.11.1.1. Local Template

[Cfg] DUT runs L2BD switching config. Each DUT uses ${phy_cores} physical core(s) for worker threads. [Ver] Measure NDR and PDR values using MLRsearch algorithm.Arguments: - frame_size - L2 Frame Size [B]. Type: integer - phy_cores - Number of worker threads to be used. Type: integer - rxq - Number of Rx queues to be used. Type: integer - acl_type - FIXME.


Set Test Variable  \${frame_size}
Given Add worker threads and rxqueues to all DUTs  ${phy_cores}  ${rxq}
  And Add PCI devices to all DUTs
  And Set Max Rate And Jumbo And Handle Multi Seg
  And Apply startup configuration on all VPP DUTs
&{vxlan1} =  Create Dictionary  vni=0  vtep=172.17.0.2
&{vxlan2} =  Create Dictionary  vni=0  vtep=172.27.0.2
@{dut1_vxlans} =  Create List  ${vxlan1}
@{dut2_vxlans} =  Create List  ${vxlan2}
Set interfaces in path up
 When Init L2 bridge domains with single DUT with Vhost-User and VXLANoIPv4 in 3-node circular topology  172.16.0.1  16  172.26.0.1  16  172.16.0.2  172.26.0.2  ${dut1_vxlans}  ${dut2_vxlans}  172.17.0.0  16  172.27.0.0  16
@{permit_list} =  Create List  10.0.0.1/32  10.0.0.2/32
Run Keyword If  '${acl_type}' != '${EMPTY}'  Configure ACLs on a single interface  ${dut1}  ${dut1_if2}  input  ${acl_type}  @{permit_list}
  And Configure chains of NFs connected via vhost-user on single node  node=DUT1  nf_chains=${nf_chains}  nf_nodes=${nf_nodes}  jumbo=${jumbo}  use_tuned_cfs=${False}  auto_scale=${True}  vnf=vpp_chain_l2xc
 Then Find NDR and PDR intervals using optimized search

10.11.1.2. tc01-114B-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=${114}  phy_cores=${1}

10.11.1.3. tc02-114B-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=${114}  phy_cores=${2}

10.11.1.4. tc03-114B-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=${114}  phy_cores=${4}

10.11.1.5. tc04-1518B-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=${1518}  phy_cores=${1}

10.11.1.6. tc05-1518B-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=${1518}  phy_cores=${2}

10.11.1.7. tc06-1518B-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=${1518}  phy_cores=${4}

10.11.1.8. tc07-9000B-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=${9000}  phy_cores=${1}

10.11.1.9. tc08-9000B-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=${9000}  phy_cores=${2}

10.11.1.10. tc09-9000B-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=${9000}  phy_cores=${4}

10.11.1.11. tc10-IMIX-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

10.11.1.12. tc11-IMIX-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

10.11.1.13. tc12-IMIX-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

10.11.2. 10ge2p1x710-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr suite

RFC2544: Packet throughput L2BD test cases with VXLANoIPv4 and vhost

[Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes. [Enc] Packet Encapsulations: Eth-IPv4 for L2 switching of IPv4. Eth-IPv4-VXLAN-Eth-IPv4 is applied on link between DUT1 and DUT2. [Cfg] DUT configuration: DUT1 and DUT2 are configured with L2 bridge- domain and MAC learning enabled. Qemu VNFs are connected to VPP via vhost-user interfaces. Guest is running VPP l2xc interconnecting vhost-user interfaces, rxd/txd=1024. DUT1/DUT2 is tested with ${nic_name}. [Ver] TG verification: TG finds and reports throughput NDR (Non DropRate) with zero packet loss tolerance and throughput PDR (Partial DropRate) with non-zero packet loss tolerance (LT) expressed in percentageof packets transmitted. NDR and PDR are discovered for differentEthernet L2 frame sizes using MLRsearch library.Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces. [Ref] Applicable standard specifications: RFC2544, RFC7348.

# Copyright (c) 2019 Cisco and/or its affiliates.
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at:
#
#     http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
| ...
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | L2BDMACLRN | ENCAP | VXLAN | L2OVRLAY | IP4UNRLAY
| ... | VHOST | VM | VHOST_1024 | VTS | ACL_PERMIT_REFLECT
| ...
| Suite Setup | Setup suite single link | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test
| Test Teardown | Tear down test | performance | vhost
| ...
| Test Template | Local Template
| ...
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | acl_plugin.so
| ${osi_layer}= | L3
| ${nic_name}= | Intel-X710
| ${overhead}= | ${50}
| ${nf_dtcr}= | ${1}
| ${nf_dtc}= | ${1}
| ${nf_chains}= | ${1}
| ${nf_nodes}= | ${1}
| ${dut1_bd_id1}= | 1
| ${dut1_bd_id2}= | 2
| ${dut2_bd_id1}= | 1
# Traffic profile:
| ${traffic_profile}=
| ... | trex-sl-ethip4vxlan-ip4src${nf_chains}udpsrcrnd
| ${acl_type}= | permit+reflect

10.11.2.1. Local Template

[Cfg] DUT runs L2BD switching config. Each DUT uses ${phy_cores} physical core(s) for worker threads. [Ver] Measure NDR and PDR values using MLRsearch algorithm.Arguments: - frame_size - L2 Frame Size [B]. Type: integer - phy_cores - Number of worker threads to be used. Type: integer - rxq - Number of Rx queues to be used. Type: integer - acl_type - FIXME.


Set Test Variable  \${frame_size}
Given Add worker threads and rxqueues to all DUTs  ${phy_cores}  ${rxq}
  And Add PCI devices to all DUTs
  And Set Max Rate And Jumbo And Handle Multi Seg
  And Apply startup configuration on all VPP DUTs
&{vxlan1} =  Create Dictionary  vni=0  vtep=172.17.0.2
&{vxlan2} =  Create Dictionary  vni=0  vtep=172.27.0.2
@{dut1_vxlans} =  Create List  ${vxlan1}
@{dut2_vxlans} =  Create List  ${vxlan2}
Set interfaces in path up
 When Init L2 bridge domains with single DUT with Vhost-User and VXLANoIPv4 in 3-node circular topology  172.16.0.1  16  172.26.0.1  16  172.16.0.2  172.26.0.2  ${dut1_vxlans}  ${dut2_vxlans}  172.17.0.0  16  172.27.0.0  16
@{permit_list} =  Create List  10.0.0.1/32  10.0.0.2/32
Run Keyword If  '${acl_type}' != '${EMPTY}'  Configure ACLs on a single interface  ${dut1}  ${dut1_if2}  input  ${acl_type}  @{permit_list}
  And Configure chains of NFs connected via vhost-user on single node  node=DUT1  nf_chains=${nf_chains}  nf_nodes=${nf_nodes}  jumbo=${jumbo}  use_tuned_cfs=${False}  auto_scale=${True}  vnf=vpp_chain_l2xc
 Then Find NDR and PDR intervals using optimized search

10.11.2.2. tc01-114B-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=${114}  phy_cores=${1}

10.11.2.3. tc02-114B-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=${114}  phy_cores=${2}

10.11.2.4. tc03-114B-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=${114}  phy_cores=${4}

10.11.2.5. tc04-1518B-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=${1518}  phy_cores=${1}

10.11.2.6. tc05-1518B-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=${1518}  phy_cores=${2}

10.11.2.7. tc06-1518B-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=${1518}  phy_cores=${4}

10.11.2.8. tc07-9000B-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=${9000}  phy_cores=${1}

10.11.2.9. tc08-9000B-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=${9000}  phy_cores=${2}

10.11.2.10. tc09-9000B-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=${9000}  phy_cores=${4}

10.11.2.11. tc10-IMIX-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

10.11.2.12. tc11-IMIX-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

10.11.2.13. tc12-IMIX-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

10.11.3. 10ge2p1x710-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr suite

RFC2544: Packet throughput L2BD test cases with VXLANoIPv4 and vhost

[Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes. [Enc] Packet Encapsulations: Eth-IPv4 for L2 switching of IPv4. Eth-IPv4-VXLAN-Eth-IPv4 is applied on link between DUT1 and DUT2. [Cfg] DUT configuration: DUT1 and DUT2 are configured with L2 bridge- domain and MAC learning enabled. Qemu VNFs are connected to VPP via vhost-user interfaces. Guest is running VPP l2xc interconnecting vhost-user interfaces, rxd/txd=1024. DUT1/DUT2 is tested with ${nic_name}. [Ver] TG verification: TG finds and reports throughput NDR (Non DropRate) with zero packet loss tolerance and throughput PDR (Partial DropRate) with non-zero packet loss tolerance (LT) expressed in percentageof packets transmitted. NDR and PDR are discovered for differentEthernet L2 frame sizes using MLRsearch library.Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces. [Ref] Applicable standard specifications: RFC2544, RFC7348.

# Copyright (c) 2019 Cisco and/or its affiliates.
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at:
#
#     http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
| ...
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | L2BDMACLRN | ENCAP | VXLAN | L2OVRLAY | IP4UNRLAY
| ... | VHOST | VM | VHOST_1024 | VTS
| ...
| Suite Setup | Setup suite single link | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test
| Test Teardown | Tear down test | performance | vhost
| ...
| Test Template | Local Template
| ...
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so
| ${osi_layer}= | L3
| ${nic_name}= | Intel-X710
| ${overhead}= | ${50}
| ${nf_dtcr}= | ${1}
| ${nf_dtc}= | ${1}
| ${nf_chains}= | ${1}
| ${nf_nodes}= | ${1}
| ${dut1_bd_id1}= | 1
| ${dut1_bd_id2}= | 2
| ${dut2_bd_id1}= | 1
# Traffic profile:
| ${traffic_profile}=
| ... | trex-sl-ethip4vxlan-ip4src${nf_chains}udpsrcrnd
| ${acl_type}= | ${EMPTY}

10.11.3.1. Local Template

[Cfg] DUT runs L2BD switching config. Each DUT uses ${phy_cores} physical core(s) for worker threads. [Ver] Measure NDR and PDR values using MLRsearch algorithm.Arguments: - frame_size - L2 Frame Size [B]. Type: integer - phy_cores - Number of worker threads to be used. Type: integer - rxq - Number of Rx queues to be used. Type: integer - acl_type - FIXME.


Set Test Variable  \${frame_size}
Given Add worker threads and rxqueues to all DUTs  ${phy_cores}  ${rxq}
  And Add PCI devices to all DUTs
  And Set Max Rate And Jumbo And Handle Multi Seg
  And Apply startup configuration on all VPP DUTs
&{vxlan1} =  Create Dictionary  vni=0  vtep=172.17.0.2
&{vxlan2} =  Create Dictionary  vni=0  vtep=172.27.0.2
@{dut1_vxlans} =  Create List  ${vxlan1}
@{dut2_vxlans} =  Create List  ${vxlan2}
Set interfaces in path up
 When Init L2 bridge domains with single DUT with Vhost-User and VXLANoIPv4 in 3-node circular topology  172.16.0.1  16  172.26.0.1  16  172.16.0.2  172.26.0.2  ${dut1_vxlans}  ${dut2_vxlans}  172.17.0.0  16  172.27.0.0  16
@{permit_list} =  Create List  10.0.0.1/32  10.0.0.2/32
Run Keyword If  '${acl_type}' != '${EMPTY}'  Configure ACLs on a single interface  ${dut1}  ${dut1_if2}  input  ${acl_type}  @{permit_list}
  And Configure chains of NFs connected via vhost-user on single node  node=DUT1  nf_chains=${nf_chains}  nf_nodes=${nf_nodes}  jumbo=${jumbo}  use_tuned_cfs=${False}  auto_scale=${True}  vnf=vpp_chain_l2xc
 Then Find NDR and PDR intervals using optimized search

10.11.3.2. tc01-114B-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=${114}  phy_cores=${1}

10.11.3.3. tc02-114B-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=${114}  phy_cores=${2}

10.11.3.4. tc03-114B-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=${114}  phy_cores=${4}

10.11.3.5. tc04-1518B-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=${1518}  phy_cores=${1}

10.11.3.6. tc05-1518B-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=${1518}  phy_cores=${2}

10.11.3.7. tc06-1518B-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=${1518}  phy_cores=${4}

10.11.3.8. tc07-9000B-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=${9000}  phy_cores=${1}

10.11.3.9. tc08-9000B-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=${9000}  phy_cores=${2}

10.11.3.10. tc09-9000B-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=${9000}  phy_cores=${4}

10.11.3.11. tc10-IMIX-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

10.11.3.12. tc11-IMIX-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

10.11.3.13. tc12-IMIX-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}