CSIT 18.07

Introduction

• Report History
• Introduction
• Test Scenarios Overview
• Physical Testbeds
  • 3-Node Xeon Haswell (3n-hsw)
  • 3-Node Xeon Skylake (3n-skx)
  • 2-Node Xeon Skylake (2n-skx)
• Performance Test Methodology
  • Throughput
  • MLRsearch Algorithm
  • Maximum Receive Rate MRR
  • Packet Latency
  • Multi-Core Speedup
  • VPP Startup Settings
  • KVM VMs vhost-user
  • LXC/DRC Container Memif
  • K8s Container Memif
  • IPSec on Intel QAT
  • TRex Traffic Generator
  • HTTP/TCP with WRK tool

VPP Performance

• Overview
  • Logical Topologies
  • Performance Tests Coverage
  • Performance Tests Naming
• Release Notes
  • Changes in CSIT-18.07
  • Known Issues
• Packet Throughput
  • L2 Ethernet Switching
  • IPv4 Routing
  • IPv6 Routing
  • SRv6 Routing
  • IPv4 Tunnels
  • IPv6 Tunnels
  • KVM VMs vhost-user
  • LXC/DRC Container Memif
  • K8s Container Memif
  • IPSec IPv4 Routing
  • VTS
• Speedup Multi-Core
  • L2 Ethernet Switching
  • IPv4 Routing
  • IPv6 Routing
  • SRv6 Routing
  • IPv4 Tunnels
  • IPv6 Tunnels
  • KVM VMs vhost-user
  • LXC/DRC Container Memif
  • K8s Container Memif
  • IPSec IPv4 Routing
  • VTS
• Packet Latency
  • L2 Ethernet Switching
  • IPv4 Routing
  • IPv6 Routing
  • SRv6 Routing
  • IPv4 Tunnels
  • IPv6 Tunnels
  • KVM VMs vhost-user
  • LXC/DRC Container Memif
  • K8s Container Memif
  • IPSec IPv4 Routing
  • VTS
• HTTP/TCP Performance
  • Connections per second
  • Requests per second
• Comparisons
  • Current vs. Previous Release
  • 3n-Skx vs. 3n-Hsw Testbeds
• Throughput Trending
• Test Environment
  • Physical Testbeds
  • Server Specifications
  • Pre-Test Server Calibration
  • Calibration Data - Haswell
  • Calibration Data - Skylake
  • SUT Settings - Linux
  • DUT Settings - VPP
  • TG Settings - TRex
• Documentation
  • Container Orchestration in CSIT
  • Test Code Documentation

DPDK Performance

• Overview
  • Logical Topologies
  • Performance Tests Coverage
• Release Notes
  • Changes in CSIT-18.07
  • Known Issues
• Packet Throughput
  • Testpmd
  • L3fwd
• Packet Latency
  • Testpmd
  • L3fwd
• Comparisons
  • Current vs. Previous Release
  • 3n-Skx vs. 3n-Hsw Testbeds
• Throughput Trending
• Test Environment
  • Physical Testbeds
  • Server Specifications
  • Pre-Test Server Calibration
  • Calibration Data - Haswell
  • Calibration Data - Skylake
  • SUT Settings - Linux
  • DUT Settings - DPDK
  • TG Settings - TRex
• Documentation

VPP Functional

• Overview
  • Virtual Topologies
  • Functional Tests Coverage
  • Functional Tests Naming
• Release Notes
  • Changes in CSIT-18.07
  • Known Issues
• Test Environment
  • SUT Settings - VIRL Guest VM
  • SUT Settings - VIRL Guest OS Linux
  • DUT Settings - VPP
  • TG Settings - Scapy
• Documentation

HoneyComb Functional

• Overview
  • Virtual Topologies
  • Functional Tests Coverage
  • Functional Tests Naming
• Release Notes
  • Changes in CSIT-18.07
  • Known Issues
• Test Environment
• Documentation

NSH_SFC Functional

• Overview
  • Virtual Topologies
  • Functional Tests Coverage
• Release Notes
  • Changes in CSIT-18.07
  • Known Issues
• Test Environment
• Documentation

DMM Functional

• Overview
  • Virtual Topologies
  • Functional Tests Coverage
• Release Notes
  • Changes in CSIT-18.07
  • Known Issues
• Test Environment
• Documentation

Detailed Results

• VPP Performance NDR/PDR
  • 3n-hsw
  • 3n-skx
  • 2n-skx
• VPP Performance MRR
  • 3n-hsw
  • 3n-skx
  • 2n-skx
• VPP K8s Container Memif
  • 3n-hsw
• DPDK Performance
  • 3n-hsw
  • 3n-skx
  • 2n-skx
• VPP Functional
  • Ubuntu
  • CentOS
• HoneyComb Functional
  • mgmt-cfg-acl-apihc-apivat-func
  • mgmt-cfg-apihcv6-func
  • mgmt-cfg-bgp-apihc-func
  • mgmt-cfg-dhcp-apihc-apivat-func
  • mgmt-cfg-int-apihcnc-func
  • mgmt-cfg-int-subint-apihc-apivat-func
  • mgmt-cfg-intip4-intip6-apihc-apivat-func
  • mgmt-cfg-inttap-apihc-apivat-func
  • mgmt-cfg-intvhost-apihc-apivat-func
  • mgmt-cfg-l2bd-apihc-apivat-func
  • mgmt-cfg-l2fib-apihc-apivat-func
  • mgmt-cfg-lisp-apihc-apivat-func
  • mgmt-cfg-lispgpe-apihc-apivat-func
  • mgmt-cfg-nsh-apihc-apivat-func
  • mgmt-cfg-pbb-apihc-apivat-func
  • mgmt-cfg-pluginacl-apihc-apivat-func
  • mgmt-cfg-policer-apihc-func
  • mgmt-cfg-proxyarp-apihc-func
  • mgmt-cfg-proxynd6-apihc-func
  • mgmt-cfg-routing-apihc-apivat-func
  • mgmt-cfg-slaac-apihc-func
  • mgmt-cfg-snat44-apihc-apivat-func
  • mgmt-cfg-spanrx-apihc-apivat-func
  • mgmt-cfg-vxlan-apihc-apivat-func
  • mgmt-cfg-vxlangpe-apihc-apivat-func
  • mgmt-notif-apihcnc-func
  • mgmt-statepersist-apihc-func
• NSH SFC Functional
  • classifier
  • proxy
  • sff
• DMM Functional
  • singlecliser-func

Test Configuration

• VPP Performance NDR/PDR
  • 3n-hsw
  • 3n-skx
  • 2n-skx
• VPP Performance MRR
  • 3n-hsw
  • 3n-skx
  • 2n-skx
• VPP K8s Container Memif
• VPP Functional
  • Ubuntu
  • CentOS

Test Operational Data

• VPP Performance NDR/PDR
  • 3n-hsw
  • 3n-skx
  • 2n-skx

CSIT Framework Documentation

• Design
  • Design Hierarchy
  • Test Lifecycle Abstraction
  • RF Keywords Functional Classification
  • RF Keywords Naming Guidelines
  • Coding guidelines
• Test Naming
  • Background
  • Naming Convention
  • Naming Examples
• Presentation and Analytics Layer
  • Overview
  • Data
  • Data processing
  • Data presentation
  • Report generation
  • Continuous Performance Measurements and Trending
  • Root Cause Analysis
  • API
• CSIT RF Tags Descriptions
  • Topology TAGs
  • Objective TAGs
  • Environment TAGs
  • NIC model tags
  • Scaling TAGs
  • Tags marking functional vs. performance of tests
  • Performance testing tags
  • Ethernet frame size tags for performance tests
  • Test type tags
  • Forwarding mode tags
  • Underlay tags
  • Overlay tags
  • Tagging tags
  • Encapsulation tags
  • Interface tags
  • Feature tags
  • Encryption tags
  • Client-workload tags
  • Container orchestration tags
  • Multi-threading tags
  • Honeycomb tags

Indices and tables

• Index