libvirt/ci
Peter Krempa bb0bec4827 ci: Install python RPMs from libvirt/libvirt-python CI artifacts
After addition of the new libvirt-client-qemu sub-package which is using
python bindings (thus creating a circular dependency between the libvirt
and libvirt-python projects) the integration jobs fail with:

  Error:
   Problem: conflicting requests
    - nothing provides python3-libvirt >= 8.9.0-1.el9 needed by libvirt-client-qemu-8.9.0-1.el9.x86_64

The libvirt-python project now provides the RPMs in artifacts:
 https://gitlab.com/libvirt/libvirt-python/-/merge_requests/96

Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Erik Skultety <eskultet@redhat.com>
2022-10-13 12:23:01 +02:00
..
buildenv ci: refresh with latest lcitool manifest 2022-10-06 05:15:54 -04:00
cirrus ci: Switch from macOS 11 to macOS 12 2022-08-24 11:07:19 +02:00
containers ci: refresh with latest lcitool manifest 2022-10-06 05:15:54 -04:00
gitlab ci: refresh with latest lcitool manifest 2022-10-06 05:15:54 -04:00
build.sh ci: Specify the shebang sequence for build.sh 2021-02-12 17:01:41 +01:00
gitlab.yml ci: refresh with latest lcitool manifest 2022-10-06 05:15:54 -04:00
helper ci: remove obsolete logic for refreshing containers/cirrus 2021-09-10 13:36:12 +01:00
integration-template.yml ci: Install python RPMs from libvirt/libvirt-python CI artifacts 2022-10-13 12:23:01 +02:00
integration.yml ci: Install python RPMs from libvirt/libvirt-python CI artifacts 2022-10-13 12:23:01 +02:00
Makefile syntax-check: Enforce sc_prohibit_backslash_alignment everywhere 2022-05-24 11:09:51 +02:00
manifest.yml ci: Switch from macOS 11 to macOS 12 2022-08-24 11:07:19 +02:00
README.rst ci: refresh with latest lcitool manifest 2022-10-06 05:15:54 -04:00
util.py ci: Avoid use of magic constants 2021-09-14 18:56:49 +02:00

CI for libvirt

This document provides some information related to the CI capabilities for the libvirt project.

GitLab CI tuning

The behaviour of GitLab CI can be tuned through a number of variables which can be set at push time, or through the UI. See ci/gitlab.yml for further details.

Cirrus CI integration

libvirt currently supports three non-Linux operating systems: Windows, FreeBSD and macOS. Windows cross-builds can be prepared on Linux by using MinGW-w64, but for both FreeBSD and macOS we need to use the actual operating system, and unfortunately GitLab shared runners are currently not available for either.

To work around this limitation, we take advantage of Cirrus CI's free offering: more specifically, we use the cirrus-run script to trigger Cirrus CI jobs from GitLab CI jobs so that the workaround is almost entirely transparent to users and there's no need to constantly check two separate CI dashboards.

There is, however, some one-time setup required. If you want FreeBSD and macOS builds to happen when you push to your GitLab repository, you need to

  • set up a GitHub repository for the project, eg. yourusername/libvirt. This repository needs to exist for cirrus-run to work, but it doesn't need to be kept up to date, so you can create it and then forget about it;

  • enable the Cirrus CI GitHub app for your GitHub account;

  • sign up for Cirrus CI. It's enough to log into the website using your GitHub account;

  • grab an API token from the Cirrus CI settings page;

  • it may be necessary to push an empty .cirrus.yml file to your github fork for Cirrus CI to properly recognize the project. You can check whether Cirrus CI knows about your project by navigating to:

    https://cirrus-ci.com/yourusername/libvirt

  • in the CI/CD / Variables section of the settings page for your GitLab repository, create two new variables:

    • CIRRUS_GITHUB_REPO, containing the name of the GitHub repository created earlier, eg. yourusername/libvirt;
    • CIRRUS_API_TOKEN, containing the Cirrus CI API token generated earlier. This variable must be marked as Masked, because anyone with knowledge of it can impersonate you as far as Cirrus CI is concerned.

    Neither of these variables should be marked as Protected, because in general you'll want to be able to trigger Cirrus CI builds from non-protected branches.

Once this one-time setup is complete, you can just keep pushing to your GitLab repository as usual and you'll automatically get the additional CI coverage.

Coverity scan integration

This will be used only by the main repository for master branch by running scheduled pipeline in GitLab.

The service is proved by Coverity Scan and requires that the project is registered there to get free coverity analysis which we already have for libvirt project.

To run the coverity job it requires two new variables: