Skip to content

Add automatic testing for live environment and installation#86

Open
ventureoo wants to merge 8 commits intomasterfrom
quicktest-integration
Open

Add automatic testing for live environment and installation#86
ventureoo wants to merge 8 commits intomasterfrom
quicktest-integration

Conversation

@ventureoo
Copy link
Copy Markdown
Member

@ventureoo ventureoo commented Feb 26, 2026

This adds automatic testing of ISO environment and system installation process through calamares using the quicktest project. The main motivation for this is to make maintaince easier, speed up the process of releasing new ISOs and improve quality of testing as it allows to test many configurations at once for each change.

It works pretty simple: Testing takes place in QEMU virtual machine, with which quicktest communicate via socket, through which predescribed actions are transmitted - keystroke sequences, which are described as simple shell script in the testcases directory. Control of the process is carried out by sequential capture of screenshots and it analysis using OCR (tesseract). The main limitation here is that you can’t pass input with a "virtual" mouse, but usually keyboard control is enough to check many things like installation process.

At the end, result of installation timelapse is uploaded into the artifacts along with ISO.

Of course, this does not allow us to identify in advance all hardware-specific issues (at least now, if we had our own runners, we could test and it just by passthrough GPU and other things in VM), but at least it gives a good QA on changes in calamares.

Some future work:

  • Add tests for BIOS installation (right now it's UEFI only)
  • Add tests for full disk encryption
  • Add installation tests via New-Cli-Installer
  • Integrate tests with calamares tree? Can be useful when developing and bisecting problematic changes before merging.

Signed-off-by: Vasiliy Stelmachenok <ventureo@cachyos.org>
Signed-off-by: Vasiliy Stelmachenok <ventureo@cachyos.org>
Signed-off-by: Vasiliy Stelmachenok <ventureo@cachyos.org>
Signed-off-by: Vasiliy Stelmachenok <ventureo@cachyos.org>
Signed-off-by: Vasiliy Stelmachenok <ventureo@cachyos.org>
@ventureoo ventureoo force-pushed the quicktest-integration branch from 1c4afa2 to dfe4a6c Compare February 26, 2026 19:27
Signed-off-by: Vasiliy Stelmachenok <ventureo@cachyos.org>
Signed-off-by: Vasiliy Stelmachenok <ventureo@cachyos.org>
@ventureoo ventureoo force-pushed the quicktest-integration branch from dfe4a6c to d575496 Compare February 26, 2026 19:59
Signed-off-by: Vasiliy Stelmachenok <ventureo@cachyos.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant