Commit Graph

51 Commits

Author SHA1 Message Date
Filip Gołaś
81144456ce rebot_splitter.py: Handle broken robot xmls
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:09 +01:00
Filip Gołaś
e8dbc91f5b requirements.txt: Add tqdm
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:09 +01:00
Filip Gołaś
793ae5b359 osfv_stability_{run,reports}.py: Add
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_run: add release rules file

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_reports: add run count

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_reports: Fix: account for parallelism in total run time

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_run.py: accept env vars

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_reports.py: save logs to dirs depending on date and revision

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_run.py: Save results in paths per run date and rev

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_reports.py: Parse date, revision, branch and support json output

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_*.py: Allow configurable LOGS_DIR using env vars

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_reports.py: Handle broken robot xmls

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_reports.py: Unpack merged results

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_reports.py: Add suites to skip config

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:08 +01:00
Filip Gołaś
8af4975813 scripts/lib/robot.sh & related: Restore old logs directory structure
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:08 +01:00
Michał Kopeć
2fecccc819 dasharo-stability/capsule-update.robot: Add BtG popup test
Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>
2026-02-10 09:40:30 +01:00
Filip Gołaś
6b792efebb Regression logs saving fix (#1231)
* scripts/lib/robot.sh: Fix regression logs overwriting

The logs of different modules are now split into subdirectories inside a
`regression_<date>` directory to make sure they won't interfere with
each other.

Using the name of the first test file/dir to do it if
the `_REGRESSION_RUN` flag is set. We know that if its set,
then robot.sh is called by `regression.sh` which only gives
a single module as the input.

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* scripts/lib/robot.sh: Make sure logs are always split

no matter if the process was interrupted, or if the
functions are being called by another process

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

---------

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-06 16:07:18 +01:00
Filip Gołaś
120f200c6d V560tnx v1.0.0 rc10 (#1202)
* .gitignore: Add _envvars, _roms directories

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* keywords.robot: Allow for the DUT ssh key to change when trying to connect via SSH in Login To Linux via SSH

* lib/tpm.robot: Check all PCRs before failing in Validate PCRs Against Event Log

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* miniPCIe-slot-verification: Skip LTE_CARD tests if card is not defined

* Stress Test Windows: use Execute Command In Terminal

Otherwise there is no timeout for the keyword and the
tests could hang forever

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* CBMEM001: Add semiauto implementation

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Set Nextboot Bootentry: compare strings as variables to fix utf decode errors

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* novacustom-mtl.robot: Add USB model t oconfig

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* novacustom-v560tne: v1.0.0-rc10 platform configs changes

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

novacustom-v560tne: Add windows support

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

v560tne: temp RTE serial tests

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

v560tne: dmidecode update version

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

v560tne: Restore fedora support flag

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

v560tne: Add USB drives model names for detection tests

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

v560tne: Add DOCKING_STATION_USB_C_CHARGING_SUPPORT

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

v560tne: add qubes support

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

v540tnd: Restore ubuntu default boot os

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

REMOVE platform-configs: restore SSH

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* acpi-driver.robot: Fix typo in deb package name

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* minipcie-slot-verification: Replace hardcoded wifi name with the configs

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Switch To Root User: Add workaround for passwordless root

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* os-specific-tasks/203.yml: Add qubesos ansible config

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* fwupd-support.robot: automate qubes

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* cpu-performance.robot: Add missing phoronix batch mode setup to automated suite

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Login To Windows Via SSH: Allow the key to change across retries

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Get Index Of Matching Option In Menu: do not use fuzzy match

It works a bit differently - the * is not a special character in
fuzzy search

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Execute Shutdown Command: Add linux systemd support

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

Execute Shutdown Command: Add some workaround for no power_led

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Measure Warmboot Time: add workaround for no RTC boot

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* platform-configs: Add RTC_BOOT_SUPPORT

https://github.com/Dasharo/open-source-firmware-validation/issues/1068

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* CBMEM suite: dynamic semiauto skips for no RTC boot support

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* network-interface-after-suspend: Add workaroud for no RTC boot

https://github.com/Dasharo/open-source-firmware-validation/issues/1068

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* linux-packages-playbook.yaml: Remove masking systemd suspend

It makes it impossible to suspend the device in conventional
ways like using the UI or via suspend key combination.
It has more cons that pros

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* cbnt.robot: Fix invalid ibg menu parsing

Due to confusing line wrapping in the menu the
state of the options following to the target
were being parsed

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* SBO: Fix test ids ENV_ID

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* fast-boot.robot: Increase wait time for systemd-analyze

50s was not always enough for bootup to finish.
150s should be better.

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* gpu-performance.robot: stability fixes

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

gpu-performance.robot: Fix string comparison error and x11 invalid display

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

gpu-performance.robot: Detect not running x11

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

gpu-performance.robot: Note that X11 is required

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

gpu-performance.robot: fix check for installed unigine-super

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

gpu-performance.robot: Add comment about display numbering bug

https://github.com/Dasharo/open-source-firmware-validation/issues/1215

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

lib/performance/common: Setup Phoronix: Upload results to openbenchmarking

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

disk-io.robot: Verify correct disk model before checking performance

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

disk-io.robot: move sleep to after skips to reduce unnecessary idle time

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* phoronix-test-suite tests: Cap run count to 3

Using:  FORCE_TIMES_TO_RUN env variable

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* lib/docs.robot: Increase time for docking station to init

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* util/fwupd-support-lvfs: stylistic changes

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

util/fwupd-support-lvfs: Remove unused variable

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

util/fwupd-support-lvfs.robot: Add missing newline in fwupd config

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* cbnt.robot: Remove newline characters from cbmem regex

The newline characters are not matched by this keyword.
Its matched line-by-line so newline characters
never appear

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* lib/utc.robot: stability fixes

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

lib/utc.robot: reboot tests add delay to prevent immediate re-login

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

lib/utc: hotplug tests: reorder disconnect/connect to end with connected

Otherwise the docking station would be left disconnected after
the tests causing further automated tests to possibly fail

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

UTC: Add dynamic skips for laptop semiautos

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* fwupd-support: Add --assume-yes to get-devices

First time its executed after a fwupd update it will prompt to send the
results to the vendor. It was not handled before.

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Execute Reboot Command: Add delay for no-power-ctrl devices

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* EXTERNAL_HEADSET: Change to list of acceptable values

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* BOOTED_OS_ID: Prevent resetting on new suite

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* warm/coldboot tests: Add dynamic semiauto skips if not supported

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* lib/robot.sh: Run all suites at once and split results later

We've made it so that the test suites are run separately so that
the logs can be organized neatly before.

Turns out that makes the state between suites get lost.
It's especially important for SSH tests which need to
always remember which OS is booted to use the correct
SSH credentials.

This commit changes this so that everything is run at once,
but the results are later parsed and split per-suite using
rebot.

An important thing to remember is that testers will often
interrupt the run using ctrl+c to get the test results
early and skip further execution. The change handles that
by trapping the INT signal and running the split
anyway.

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

lib/robot.sh: Move robot to fg instead of waiting

When running robot as a subprocess it wont receive the control
over stdin otherwise. Some semi-auto tests require user input
in terminal which will crash otherwise.

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

lib/robot.sh: fix detecting tags

tests that are fullauto on some and semi on some platforms
need to have both tags so that they are executed no matter
the `-i` param and the skips can take care of whether
the test is automated on given platform or not

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* TEST_TAGS: rename to INCLUDE_TAGS

Theres a builtin ${TEST TAGS}, but for some reason ${TEST_TAGS}
seems to be like an alias to it.

Our variable that keeps track of the tags requested by tester
needs to be changed because of that

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* options-lib_dcu: Set nextboot before Set UEFI Option

Set UEFI Option of options-lib_dcu reads the current
SMM Store, modifies it, and flashes it back.

If we set the Nextboot variable in SMM before reading
the SMM store it will stay after flash and reboot reducing
an unnecessary DEFAULT_BOOT_OS_ID boot.

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* sleep-lib.robot: warn on failed fwts sleep

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

sleep-lib: Add description of s3 test also working for s2idle(soix)

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* keywords.robot: Identify Path To USB: Fix returning TYPE instead of PATH

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* capsule-update.robot: Skip unnecessary setup when on ssh

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* scripts/lib/robot.sh & related: Restore old logs directory structure

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* audio-subsystem.robot: Delete old version of suite

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* platform-configs/include/protectli-vp66xx.robot: enable redundant boot

Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>

* coreboot-redundant-boot.robot: work with the new log convention

Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>

* platform-configs/include/protectli-vp66xx.robot: enable CBnT w/ status menu

Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>

* lib/bios/menus.robot: Parse Menu Snapshot Into Construction: drop fuzzy search

Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>

* platform-configs/include/protectli-vp66xx.robot: remove unused variable

Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>

* coreboot-redundant-boot.robot: RTC BUC Control Bit Should Be: don't convert case

Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>

* coreboot-redundant-boot.robot: parse log from current boot only

Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>

---------

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>
Co-authored-by: Michał Kopeć <michal.kopec@3mdeb.com>
2026-02-06 13:02:09 +01:00
Michał Iwanicki
99ea67bd68 scripts/lib/robot.sh: set overall_rc to 1 on fail
Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>
2025-12-08 16:06:01 +01:00
Filip Gołaś
e33b1445f3 pre-commit fix 2025-11-05 09:54:43 +01:00
Filip Gołaś
789744b1bf scripts/lib/robot.sh: Give matched tests and tags to robot as vars
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2025-11-05 09:54:42 +01:00
Michał Żygowski
4f10afbdbc Odroid h4 ultra tests (#881)
* dasharo-compatibility/network-speed.robot: Move keywords to lib

The keywords are generic for network performance testing. They can
be reused by other tests, e.g. incoming ODROID netcard test.

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* dasharo-compatibility/odroid-netcard.robot: Add netcard test

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* dasharo-compatibility/memory-ibecc.robot: Add IBECC tests

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* platform-configs: Add ODROID H4 Ultra

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* dasharo-performance/fast-boot.robot: Make the test work with telnet

The test assumed that the device is already booted to an OS, which probably
is true for laptops. Add necessary Power On's and initial booting to OS
on the beginning of the test to handle a case where the serial connection
can be used to navigate and select OSes to boot.

Also do not log in to OS again after "Measure FW Boot Time On Linux",
because this keyword keeps the connection to the OS.

TEST=Run the test and PASS it on ODROID H4 Ultra

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* lib/sleep-lib.robot: Make sleep tests work with telnet

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* test_cases.json: Add new test cases

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* platform-configs/odroid-h4: Do not verify FW version after flashing

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* compatibility/custom-network-boot-entries.robot: Ensure netboot is enabled

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* platform-configs/odroid-h4: Add CPU temperature threshold

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* platform-configs/odroid-h4: Update release date

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* variables.robot: Fix the configs for ODROID platforms

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* dasharo-compatibility/miniPCIe-slot-verification.robot: Fix skip

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* dasharo-compatibility/nvme-support.robot: Use configs to get disk name

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* platform-configs: Drop unused CLEVO_DISK

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* platform-configs/odroid-h4: Synchronize configs

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* platform-configs/odroid-h4: Enable Windows tests

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* os-config/ansible/os-specific-tasks/201.yaml: Add docker installation

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* scripts/lib/robot.sh: Fix typo in directory name

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* platform-configs/odroid-h4: Disable fan speed measurements

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* lib/usb-hid-msc-lib.robot: Fix condition for mounting USB

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* compatibility/device-detection.robot: Close connections at the end of teardown

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* compatibility/device-detection.robot: Add proper checks for suite skip

Judging by the content of test cases, the suite depends on the
SSH connection method and the DCU backed for option manipulation.
It is not suitable for runnign in other configuration, like
telnet connection method and option management via firmware setup.

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* platform-configs/odroid-h4: Update release version

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* compatibility/efibootmgr.robot: Make test suitable for telnet platforms

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* keywords.robot: Wait for the power to stabilize before pressing power button

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* util/basic-platform-setup.robot: Mark suite as automated

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* test_cases.json: Sort new tests by ID

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* compatibility/audio-subsystem.robot: Use generic keyword for command

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* compatibility/cpu-fan-speed-measure.robot: Skip suite earlier to save time

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* lib/network.robot: Make intervals larger for Get Hostname Ip

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* platform-configs/odroid-h4: Disable hybrid core support

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* lib/network.robot: Add variable for Get Ip interval

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* scripts/regression-rerun-failed.sh: Add script to rerun failed tests

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* compatibility/efibootmgr.robot: Ensure network boot is disabled initially

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* platform-configs/odroid-h4: Fix CPU temperature threshold

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* lib/power-after-fail-lib.robot: Fix import failure

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* compatibility/reset-to-defaults.robot: Skip fan profile test if not supported

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* compatibility/platform-suspend-and-resume.robot: Check for skip in suite setup

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* compatibility/reset-to-defaults.robot: Skip sleep type test if not supported

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* Deploy UEFI Shell where necessary

Basic platform setup deploye UEFI SHell, however running a whole
suite like comaptibility, e.g. during regression, causes the FW
to eb flashed again and the UEFI Shell is lost right after basic
platform setup finishes its job.

Ensure the UEFI Shell is deployed wherever it is used.

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* lib/esp-scanning-lib.robot: Sync filesystem after cleaning ESP

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* dasharo-compatibility/DTS: Skip flashing if FW variable not set

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* dasharo-compatibility/dasharo-tools-suite.robot: Fix internal flashing

"Flash Via Internal Programmer" sends a file to DUT from host. However,
the test downloads th binary with wget prior to the keyword execution.
Skip the wrapper and call "Flash Via Internal Programmer With Args"
directly.

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* dasharo-security/tpm: Fix TPM tests

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* dasharo-security/verified-boot.robot: Sync filesystem before power cycling

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* dasharo-compatibility/audio-subsystem.robot: Fix headphones Windows tests

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* dasharo-compatibility/audio-subsystem.robot: Make audo devices platform-specific

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* lib/bios/menus.robot: Fix variable type

Fixes the error of variable value not a list or list-like.

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* dasharo-security/verified-boot.robot: Drop VBO011.001 duplication

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* lib/sleep-lib.robot: Fix suspend test on Telnet

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* platform-configs/odroid-h4: Remove obsolete override

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* scripts/regression.sh: Run stability suite too

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* platform-configs/odroid-h4-ultra.robot: Sync DTS E2E variables

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* platform-configs/odroid-h4: Sync DMI info

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* dasharo-stability/tpm-detect.robot: Drop check for NVME in TPM detection

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* dasharo-compatibility/power-after-fail.robot: Fix powering on based on var state

When power after fail test are executed, the state of power after fail variable
is changed. The Power On keyword does not take it int oaccount and uses only
the default state of the variable. This results in obsolete power button presses
which often lead to powering off the platform right after PSU is powered on.
Because of that the tests fail due to power LED not being lit up.

Define another variable that is updated runtime and represents current state of
the power after faile variable.

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* keywords: Fix usage in teardown

Fixes the problem: 'Set Tags' cannot be used in suite teardown.

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* dasharo-compatibility: Fix list comparison in Ethernet tests

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* platform-configs/odroid-h4-ultra.robot: Update Ethernet info

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* util/basic-platform-setup.robot: Add minimal-regression tag

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* lib/secure-boot-lib.robot: Fix launching UEFI Shell

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* lib/linux.robot: Add MKTME to dmesg error allowlist

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* variables.robot: Add ODROID H4 Ultra

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* dasharo-compatibility: Move netcard test to ETHPERF

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* dasharo-compatibility/network-speed.robot: merge netcard test with ETHPERF001

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* dasharo-compatibility/device-detection.robot: Fix duplicated close connection

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

* platform-configs: Drop unused ODROID_NETCARD_SUPPORT

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>

---------

Signed-off-by: Michał Żygowski <michal.zygowski@3mdeb.com>
2025-09-24 07:47:30 +02:00
Filip Gołaś
4e2d9a9350 scripts/lib/robot.sh: Comment-out-back the full command debug print
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2025-08-28 13:41:22 +02:00
Filip Gołaś
f96b32e180 lib/robot.sh: Allow changing logs dir
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2025-08-06 11:47:52 +02:00
Filip Gołaś
2ff0359d31 lib/robot.sh: Disable dirty tree checks on CI
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2025-07-31 10:28:57 +02:00
Filip Gołaś
88266c789e robot.sh handle errors when checking dirty tree
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2025-07-25 12:07:23 +02:00
Filip Gołaś
712c9f98d6 scripts/lib/robot.sh: Improve dirty check messages
Co-authored-by: Maciej Pijanowski <maciej.pijanowski@3mdeb.com>
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2025-07-23 12:14:19 +02:00
Filip Gołaś
f32044b1ef scripts/lib/robot.sh: Check if local commit pushed to remote
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2025-07-23 12:14:19 +02:00
Filip Gołaś
2bda550ad8 scripts/lib/robot.sh: Prevent running on dirty tree
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2025-07-23 12:14:15 +02:00
Filip Gołaś
824b3fc932 scripts/lib/robot.sh: Return RC depending on test results
based on 1fdf4f2b6d

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2025-07-09 08:26:13 +02:00
Jakub Redmerski
1c0bc3e13e scripts add: creating separate direcotry for regresion runs
Signed-off-by: Jakub Redmerski <jakub.redmerski@3mdeb.com>
2025-04-10 15:14:24 +02:00
Jakub Redmerski
535faf724c scripts/lib/robot.sh update: more detailed naming convetion of the result test dirs
Signed-off-by: Jakub Redmerski <jakub.redmerski@3mdeb.com>
2025-04-10 15:14:20 +02:00
Sebastian Czapla
83a63b0c52 scripts/lib/robot.sh: Fix incorrect variable name (#775)
Signed-off-by: Sebastian Czapla <sebastian.czapla@3mdeb.com>
2025-04-09 12:22:24 +02:00
Filip Gołaś
44c0469a41 scripts/lib/robot.sh: Allow no RTE_IP
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2025-04-09 10:17:08 +02:00
Filip Gołaś
33f0c4a264 cfc-fan-off: Add CPU load gradation & measurement graphs
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2025-02-21 12:26:43 +01:00
Sebastian Czapla
100632196a tpm-support: Merge TPM variables
Signed-off-by: Sebastian Czapla <sebastian.czapla@3mdeb.com>
2025-02-04 15:09:00 +01:00