CSIT-2005

Introduction

• Report History
• Report Structure
• Test Scenarios
• Physical Testbeds
  • 2-Node Xeon Cascade Lake (2n-clx)
  • 2-Node Xeon Skylake (2n-skx)
  • 3-Node Xeon Skylake (3n-skx)
  • 3-Node Xeon Haswell (3n-hsw)
  • 2-Node Atom Denverton (2n-dnv)
  • 3-Node Atom Denverton (3n-dnv)
  • 3-Node ARM TaiShan (3n-tsh)
• Test Methodology
  • Terminology
  • VPP Forwarding Modes
  • Tunnel Encapsulations
  • VPP Features
  • Data Plane Throughput
  • Packet Latency
  • Multi-Core Speedup
  • Hoststack Testing
  • Reconfiguration Tests
  • VPP Startup Settings
  • KVM VMs vhost-user
  • LXC/DRC Container Memif
  • NFV Service Density
  • VPP_Device Functional
  • IPSec on Intel QAT
  • TRex Traffic Generator

VPP Performance

• Overview
  • Logical Topologies
  • Performance Tests Coverage
  • Performance Tests Naming
• Release Notes
  • Changes in CSIT-2005
  • Known Issues
  • Root Cause Analysis for Performance Changes
• Packet Throughput
  • L2 Ethernet Switching
  • IPv4 Routing
  • IPv6 Routing
  • SRv6 Routing
  • IPv4 Tunnels
  • KVM VMs vhost-user
  • LXC/DRC Container Memif
  • IPSec IPv4 Routing
  • Virtual Topology System
• Speedup Multi-Core
  • L2 Ethernet Switching
  • IPv4 Routing
  • IPv6 Routing
  • SRv6 Routing
  • IPv4 Tunnels
  • KVM VMs vhost-user
  • LXC/DRC Container Memif
  • IPSec IPv4 Routing
  • Virtual Topology System
• Packet Latency
  • L2 Ethernet Switching
  • IPv4 Routing
  • IPv6 Routing
  • SRv6 Routing
  • IPv4 Tunnels
  • KVM VMs vhost-user
  • LXC/DRC Container Memif
  • IPSec IPv4 Routing
• Soak Tests
  • 2n-clx
  • 2n-skx
• Reconfiguration Tests
  • VNF Service Chains
• NFV Service Density
  • VNF Service Chains Routing
  • CNF Service Chains Routing
  • CNF Service Pipelines Routing
  • VNF Service Chains Tunnels
• Hoststack Testing
  • TCP/IP with iperf3
  • QUIC/UDP/IP with vpp_echo
• Comparisons
  • Current vs Previous Release
  • 3n-Skx vs 3n-Hsw Testbeds
  • 2n-Skx vs 2n-Clx Testbeds
  • 2n-Clx vs 3n-Hsw Testbeds
  • 3n-Skx vs 2n-Skx Testbeds
  • NICs Comparison
• Throughput Trending
• Test Environment
  • Environment Versioning
  • Physical Testbeds
  • Server Specifications
  • SUT Settings - Linux
  • DUT Settings - VPP
  • TG Settings - TRex
  • Pre-Test Server Calibration
• Documentation
  • Container Orchestration in CSIT
  • Test Code Documentation

DPDK Performance

• Overview
  • Logical Topologies
  • Performance Tests Coverage
• Release Notes
  • Changes in CSIT-2005
  • Known Issues
• Packet Throughput
  • 2n-skx-xxv710
  • 2n-skx-x710
  • 3n-skx-xxv710
  • 3n-skx-x710
  • 2n-clx-xxv710
  • 2n-clx-x710
  • 3n-hsw-xl710
  • 3n-hsw-x710
• Packet Latency
  • 2n-skx-xxv710
  • 3n-skx-xxv710
  • 2n-clx-xxv710
  • 3n-hsw-xl710
• Comparisons
  • Current vs Previous Release
  • 2n-Skx vs 2n-Clx Testbeds
  • 3n-Skx vs 3n-Hsw Testbeds
  • 3n-Skx vs 2n-Skx Testbeds
• Throughput Trending
• Test Environment
  • Environment Versioning
  • Physical Testbeds
  • Server Specifications
  • SUT Settings - Linux
  • DUT Settings - DPDK
  • TG Settings - TRex
  • Pre-Test Server Calibration
• Documentation

VPP Device

• Overview
  • Virtual Topologies
  • Functional Tests Coverage
  • Tests Naming
• Release Notes
  • Changes in CSIT-2005
  • Known Issues
• Integration Tests
  • Abstract
  • Overview
  • Physical Testbeds
  • Containers
  • Environment initialization
  • VF reservation
  • Network traffic isolation - Intel i40evf
  • Open tasks
  • Links
• Documentation

Detailed Results

• VPP Throughput
  • L2 Ethernet Switching
  • IPv4 Routing
  • IPv6 Routing
  • SRv6 Routing
  • IPv4 Tunnels
  • IPv6 Tunnels
  • KVM VMs vhost-user
  • LXC/DRC Container Memif
  • IPsec IPv4 Routing
  • Virtual Topology System
  • LoadBalancer
• VPP MRR
  • L2 Ethernet Switching
  • IPv4 Routing
  • IPv6 Routing
  • SRv6 Routing
  • IPv4 Tunnels
  • KVM VMs vhost-user
  • LXC/DRC Container Memif
  • IPsec IPv4 Routing
  • Virtual Topology System
  • NFV Service Density
• DPDK Throughput
  • 2n-skx
  • 3n-skx
  • 2n-clx
  • 3n-hsw
  • 3n-tsh
• VPP Device
  • container memif
  • crypto
  • interfaces
  • ip4
  • ip4 tunnels
  • ip6
  • ip6 tunnels
  • l2bd
  • l2patch
  • l2xc
  • srv6
  • vm vhost

Test Configuration

• VPP Throughput
  • L2 Ethernet Switching
  • IPv4 Routing
  • IPv6 Routing
  • SRv6 Routing
  • IPv4 Tunnels
  • IPv6 Tunnels
  • KVM VMs vhost-user
  • LXC/DRC Container Memif
  • IPsec IPv4 Routing
  • Virtual Topology System
  • LoadBalancer
• VPP MRR
• VPP Device
  • container memif
  • crypto
  • interfaces
  • ip4
  • ip4 tunnels
  • ip6
  • ip6 tunnels
  • l2bd
  • l2patch
  • l2xc
  • srv6
  • vm vhost

Test Operational Data

• VPP Throughput
  • L2 Ethernet Switching
  • IPv4 Routing
  • IPv6 Routing
  • SRv6 Routing
  • IPv4 Tunnels
  • IPv6 Tunnels
  • KVM VMs vhost-user
  • LXC/DRC Container Memif
  • IPsec IPv4 Routing
  • Virtual Topology System
  • LoadBalancer

CSIT Framework Documentation

• Design
  • Design Hierarchy
  • Test Lifecycle Abstraction
  • RF Keywords Functional Classification
  • RF Keywords Naming Guidelines
  • Coding Guidelines
• Test Naming
  • Background
  • Naming Convention
  • Naming Examples
• Presentation and Analytics
  • Overview
  • Data
  • Data processing
  • Data presentation
  • Report generation
  • Continuous Performance Measurements and Trending
  • Root Cause Analysis
  • API
• CSIT RF Tags Descriptions
  • Testbed Topology Tags
  • Objective Tags
  • Environment Tags
  • NIC Model Tags
  • Scaling Tags
  • Test Category Tags
  • Performance Type Tags
  • Ethernet Frame Size Tags
  • Test Type Tags
  • NF Service Density Tags
  • Forwarding Mode Tags
  • Underlay Tags
  • Overlay Tags
  • Tagging Tags
  • Encapsulation Tags
  • Interface Tags
  • Feature Tags
  • Encryption Tags
  • Client-Workload Tags
  • Container Orchestration Tags
  • Multi-Threading Tags
  • Honeycomb Tags