1
0
mirror of https://passt.top/passt synced 2024-06-29 22:42:46 +00:00
passt/test
Stefano Brivio c5f4ba1b1b Makefile: Ugly hack to get a "plain" Markdown version of README
Distribution packages reasonably expect to have a human-readable
Markdown version of the README under /usr/share/doc/, but all we have
right now is a heavily web-oriented version.

Introduce a ugly hack to strip web-oriented parts from the current
README and install it.

It should probably work the other way around: a human-readable README
could be used as a source for the web page. But cgit needs a file
that's in the tree, not something that can be built, and
https://passt.top/ is based on cgit. It should eventually be doable
to work around this in cgit, instead.

Reported-by: Benson Muite <benson_muite@emailplus.org>
Signed-off-by: Stefano Brivio <sbrivio@redhat.com>
2022-08-20 19:07:12 +02:00
..
build tests: Remove not-very-useful "req" directive 2022-07-14 01:32:42 +02:00
demo contrib, test: Rebase Podman patch, enable three-way merge on git am in demo 2022-08-01 12:45:05 +02:00
dhcp Separately locate external interfaces for IPv4 and IPv6 2022-07-30 21:57:50 +02:00
distro Makefile: Ugly hack to get a "plain" Markdown version of README 2022-08-20 19:07:12 +02:00
env LICENSES: Add license text files, add missing notices, fix SPDX tags 2021-10-20 08:29:30 +02:00
icmp tests: Explicitly list test files in test/run, remove "onlyfor" support 2022-07-14 01:32:42 +02:00
lib tests: Clean up better after iperf tests 2022-07-22 19:42:18 +02:00
ndp Separately locate external interfaces for IPv4 and IPv6 2022-07-30 21:57:50 +02:00
perf tests: Explicitly list test files in test/run, remove "onlyfor" support 2022-07-14 01:32:42 +02:00
tcp tests: Use socat instead of netcat 2022-07-22 19:41:42 +02:00
two_guests Separately locate external interfaces for IPv4 and IPv6 2022-07-30 21:57:50 +02:00
udp tests: Remove unnecessary truncation of temporary files in udp tests 2022-07-22 19:42:18 +02:00
valgrind tests: Explicitly list test files in test/run, remove "onlyfor" support 2022-07-14 01:32:42 +02:00
.gitignore tests: Prepare distro images during asset build phase 2022-07-14 01:36:02 +02:00
ci test: Add CI/demo scripts 2021-09-27 15:10:35 +02:00
find-arm64-firmware.sh tests: Search multiple places for aarch64 EDK2 bios image 2022-07-14 01:32:42 +02:00
Makefile tests: Prepare distro images during asset build phase 2022-07-14 01:36:02 +02:00
passt.mbuto tests: Use socat instead of netcat 2022-07-22 19:41:42 +02:00
prepare-distro-img.sh Makefile: Ugly hack to get a "plain" Markdown version of README 2022-08-20 19:07:12 +02:00
README.md tests: Use socat instead of netcat 2022-07-22 19:41:42 +02:00
run tests: Explicitly list test files in test/run, remove "onlyfor" support 2022-07-14 01:32:42 +02:00
run_demo test: Add CI/demo scripts 2021-09-27 15:10:35 +02:00
valgrind.supp test, seccomp, Makefile: Switch to valgrind runs for passt functional tests 2022-03-29 15:35:38 +02:00

Scope

This directory contains test cases for passt and pasta and a simple POSIX shell-based framework to define them, and run them as a suite.

These tests can be run as part of a continuous integration workflow, and are also used to provide short usage demos, with video recording, for passt and pasta basic use cases.

Run

Dependencies

Packages

The tests require some package dependencies commonly available in Linux distributions. If some packages are not available, the test groups that need them will be selectively skipped.

This is a non-exhaustive list of packages that might not commonly be installed on a system, i.e. common utilities such as a shell are not included here.

Example for Debian, and possibly most Debian-based distributions:

build-essential git jq strace iperf3 qemu-system-x86 tmux sipcalc bc
clang-tidy cppcheck isc-dhcp-common psmisc linux-cpupower socat
netcat-openbsd fakeroot lz4 lm-sensors qemu-system-arm qemu-system-ppc
qemu-system-misc qemu-system-x86 valgrind

Other tools

Test measuring request-response and connect-request-response latencies use neper, which is not commonly packaged by distributions and needs to be built and installed manually:

git clone https://github.com/google/neper
cd neper; make
cp tcp_crr tcp_rr udp_rr /usr/local/bin

Virtual machine images are built during test executions using mbuto, the shell script is sourced via git as needed, so there's no need to actually install it.

Special requirements for continuous integration and demo modes

Running the test suite as continuous integration or demo modes will record the terminal with the steps being executed, using asciinema(1), and create binary packages.

The following additional packages are commonly needed:

alien asciinema linux-perf tshark

Regular test

Just issue:

./run

from the test directory. Elevated privileges are not needed. Environment variable settings: DEBUG=1 enables debugging messages, TRACE=1 enables tracing (further debugging messages), PCAP=1 enables packet captures. Example:

PCAP=1 TRACE=1 ./run

Continuous integration

Issuing:

./ci

will run the whole test suite while recording the execution, and it will also build JavaScript fragments used on http://passt.top/ for performance data tables and links to specific offsets in the captures.

Demo mode

Issuing:

./demo

will run the demo cases under demo, with terminal captures as well.

Framework

The implementation of the testing framework is under lib, and it provides facilities for terminal and tmux session management, interpretation of test directives, video recording, and suchlike. Test cases are organised in the remaining directories.

Test cases can be implemented as POSIX shell scripts, or as a set of directives, which are not formally documented here, but should be clear enough from the existing cases. The entry point for interpretation of test directives is implemented in lib/test.