22 Commits

Author SHA1 Message Date
Wiktor Mowinski 178fd2aaf4 dasharo-compatibility/usb-type-c.robot: fix indexing
Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>
2026-04-24 12:39:58 +02:00
Wiktor Mowinski 4ca95673ce test_cases.json: fix ids and names
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>
2026-04-24 12:39:58 +02:00
Filip Gołaś 397eddbb74 Docking Station Detection After Coldboot: do manual coldboot if POWER_CTRL=none
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-04-24 12:39:56 +02:00
Filip Gołaś 76de3659a7 utc.robot: Detect dock in UTC*0[78] tests the same way as in others
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-04-24 12:39:55 +02:00
Filip Gołaś acc345dc19 utc.robot: Detect any USB audio device instead of brittle name matching
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-04-24 12:39:55 +02:00
Filip Gołaś 1aa420edef docks.robot, utc.robot: Add Displaylink display detection
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-04-24 12:39:55 +02:00
Filip Gołaś 6bb23b0023 Sync with internal develop (#1258)
commit 11383f4f295d0a1511344eff4f52acd167f02687
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Mar 10 06:22:24 2026 +0100

    fwupd-support.robot: Add missing Power On in local firmware update

    Only affects devices with power control which might stay powered off
    after the update

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit a94c0b091355a0e383a8db54ee8bdb4b01ac1448
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Fri Mar 6 10:29:00 2026 +0100

    fwupd tests: Workaround for changing system firmware device name

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit a0138c9c59f712f1ff6704fff1907e675ae8af5e
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Wed Mar 4 06:41:51 2026 +0100

    fwupd.resource: Fix AC detection workaround for laptop & no battery

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit a866fa664a1a86bc12241cb3422d734b81e1ce2c
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Mar 3 09:53:34 2026 +0100

    Qubes OS: Replace all occurrences of 'QubesOS' with 'Qubes OS'

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit fdc00c8dade6c0714ae3016466f5d22bfc773d53
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Mar 3 09:00:24 2026 +0100

    fwupd-support.robot: Add workaround for get-updates asking for uploading results

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 61b618223e1743f8c63a6e97893c1c2691026ef2
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Mar 3 08:42:58 2026 +0100

    scripts/lib/robot.sh: Fix no tags producing `[""]` instead of `[]`

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 27e51ad032e7d4d79131ee817bf48693a496bd8d
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Mar 3 08:20:47 2026 +0100

    fwupd tests: Add dynamic semiauto tags checks

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 67c12fdafea6c81fa4565e58b4bc78db09141411
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Mar 3 07:59:12 2026 +0100

    lib/fwupd.resourc: Add output for ac not connected in  subcommand

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit b26e21cfe3399e364917d4465f572abc9c662c31
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Mar 3 07:36:44 2026 +0100

    fwupd tests: Separate common battery workaround code into lib

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit abb84d7f5c4ea778df688b53d580017cea91038a
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Mar 3 07:09:09 2026 +0100

    squash! fwupd tests: Add battery discharge workaround

    Unify battery discharge time in both fwupd suites

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 67e9e08463ef7dad0084bf02afabce8d75146775
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Wed Feb 25 08:22:49 2026 +0100

    fwupd tests: Add battery discharge workaround

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 7b9359a09c7cc45c951525550807c2b671919050
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Wed Feb 25 08:22:02 2026 +0100

    fwupd-support.robot: Add more test cases

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 27780e1bdfc740c03f35a25d39da696c9b004eb2
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Wed Mar 11 14:03:08 2026 +0100

    README.md: Replace instability warning with suggestion to use release tags

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 1c9d25621f
Author: Michał Kopeć <michal.kopec@3mdeb.com>
Date:   Thu Feb 12 12:28:22 2026 +0100

    docs/novacustom.md: add link to ec downgrade procedure

    Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>

commit fe73d19deb
Author: Michał Kopeć <michal.kopec@3mdeb.com>
Date:   Thu Oct 30 13:13:02 2025 +0100

    docs/novacustom.md: document v0.9.0 downgrade bug

    Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>

commit 2e517d8a46
Author: Wiktor Mówiński <wiktor.mowinski@3mdeb.com>
Date:   Tue Feb 24 14:44:42 2026 +0100

    test_cases.json:fix net spd test (#1247)

    Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

commit e11604b03a
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Mon Feb 23 10:58:52 2026 +0100

    test_cases.json: Add missing tests and fix changed_to's (#1246)

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit b9fb65a212
Author: Wiktor Mówiński <wiktor.mowinski@3mdeb.com>
Date:   Mon Feb 23 09:38:58 2026 +0100

    test_cases.json: fix spelling and such (#1244)

    * test_cases.json: fix spelling and such

    Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

    test_cases.json: fix

    Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

    * test_cases.json: fixname

    Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

    * test_cases.json:remaining tests

    Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

    * test_cases.json: add WLE

    Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

    * check_tests_consistency.py: script lists diffs in test_cases.json and modules

    Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

    * dasharo-compatibility/*:fix

    Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

    * test_cases.json: fix

    Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

    ---------

    Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

commit 9d2f1c6e64
Merge: ac35515f21 c62f6e7283
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Fri Mar 6 09:17:16 2026 +0100

    Merge pull request 'osfv-stable-release-improvements' (#3) from osfv-stable-release-improvements into develop

    Reviewed-on: https://git.3mdeb.com/dasharo/open-source-firmware-validation/pulls/3

commit c62f6e7283
Merge: a8a11ed08e ac35515f21
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Fri Mar 6 09:16:09 2026 +0100

    Merge branch 'develop' into osfv-stable-release-improvements

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit a8a11ed08e
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Fri Mar 6 08:44:50 2026 +0100

    Login To Booted OS: Fix continuing on fail to login

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit d1f032a006
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Fri Mar 6 08:34:25 2026 +0100

    cpu-performance: Fix FORCE_TIMES_TO_RUN envvar set command

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit cd3c48cf53
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Fri Mar 6 06:48:37 2026 +0100

    scripts/regression.sh: Fix scope change

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 23334fa5c9
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Mar 3 14:38:10 2026 +0100

    release_tests_devices.tst: Revert using temporary desk setup devices

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 89be9ac5b8
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Mar 3 09:39:29 2026 +0100

    osfv_stability_reports.py: Differentiate run dates in caches and reports

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 5862e59fe0
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Thu Feb 26 20:28:15 2026 +0100

    osfv_stability_reports.py: Add per-suite cache

    For suites which take a long long time to process,
    to not lose the time spent processing it if the
    processing is interrupted

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 9b2f3dd458
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Mon Feb 23 10:36:43 2026 +0100

    release_tests_rules.json: Add automated tag filter

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 42197f4b4d
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Mon Feb 23 10:33:40 2026 +0100

    develop_pr_auto_regression.py: Fix orphan robot processes

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit c025d2a2a4
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Mon Feb 23 10:07:57 2026 +0100

    scripts/ci/regression-scope: Preserve suites order

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 7f2743c744
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Mon Feb 23 09:43:57 2026 +0100

    osfv_stability_run.py: Fix logs_base undefined on custom logs dir

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 1ea7418873
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Mon Feb 23 09:42:31 2026 +0100

    develop_pr_auto_regression.py: Only compare revs if files list not overridden

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 5dc73bf952
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Mon Feb 23 09:40:43 2026 +0100

    dts-lib.robot: Add semiauto test skip for flashing kwd

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit d28043c8df
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Mon Feb 23 08:48:40 2026 +0100

    release_tests_suite_list.txt: Use util/prepare-platform instead of module inits

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit fd6c5030d5
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Mon Feb 23 08:47:34 2026 +0100

    util/prepare-platform.robot: Add util test for running Prepare Platform

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 813e27fe1c
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Mon Feb 23 08:47:02 2026 +0100

    lib/prepare-platform.resource: Unify redundant Prepare Platform definitions

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 8433e4fa3a
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Mon Feb 23 06:39:23 2026 +0100

    release_tests_suite_list.txt: Remove duplicated __init__s

    robot crashes otherwise

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 4c7fbb3181
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Fri Feb 20 15:09:20 2026 +0100

    SSH Login keywords: Limit retries to 5m instead of fixed try count

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 0059a2c65a
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Fri Feb 20 12:57:03 2026 +0100

    keywords.robot: Fix ssh_retries being passed as timeout

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit d23fe71cd3
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Fri Feb 20 11:46:24 2026 +0100

    release_tests_devices.txt: Remove nucbox

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 03c100ef32
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Thu Feb 19 21:27:22 2026 +0100

    Login To Booted OS: Fix infinite recovery loop

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit a71088123f
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Wed Feb 18 09:14:46 2026 +0100

    novacustom-nuc_box-155H_00254.json: Update device IP

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 64a2212ef8
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Wed Feb 18 08:57:15 2026 +0100

    novacustom-v540tnd_00266.json: Update device ip

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit b534fb4461
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Wed Feb 18 08:40:22 2026 +0100

    manual_cpu_performance.robot: Limit runs to 3

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 9d77293ff3
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Wed Feb 18 08:29:48 2026 +0100

    cpu-performance.robot: Limit test runs to 3

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit a696e896f9
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Wed Feb 18 07:56:06 2026 +0100

    SSH Boot System: Always reinit connection to fix 'No open connections' errors

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit ae8e33eedb
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Wed Feb 18 07:28:13 2026 +0100

    lib/flash.robot: Read Firmware include ME and IFD

    We might assume the read firmware contains some IFD
    or ME later, not reading them would result in a brick
    and doesn't increase the read time that much.

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 37daf5a624
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Wed Feb 18 07:17:41 2026 +0100

    BPS006: Put temp tiles in /tmp to prevent littering if cleanup fails

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit e182f312fc
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Wed Feb 18 07:17:16 2026 +0100

    lib/dcu.robot: Put temp tiles in /tmp to prevent littering if cleanup fails

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 51d341c107
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 17 16:09:16 2026 +0100

    platform-configs/novacustom: Update dmidecode values

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit cb7e258cc2
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 17 16:07:43 2026 +0100

    platform-configs/pcengines: Update dmidecode values

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 0e19931887
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 17 16:02:24 2026 +0100

    verified-boot.robot: Run DCU locally to keep DUT from downloading containers

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit c47d9a8358
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 17 12:45:57 2026 +0100

    tpm-support.robot: Add missing skips for serial-only tests

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 3b11971f16
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 17 12:37:33 2026 +0100

    osfv-test-data: Bump version

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit d860093340
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 17 10:11:42 2026 +0100

    uefi-shell.robot: Use library keywords to perform test

    Otherwise it was failing on MSI z690.
    It's always better to use common and working
    keywords instead of reinventing the wheel.

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 951b42230b
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 17 09:27:40 2026 +0100

    msi-z690-common.robot: Change keyboard model to fit hardware matrix

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 82bff0f0c2
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 17 09:19:36 2026 +0100

    novacustom-nu_box-155H_00254.json: Update device IP

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit b065131117
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Mon Feb 16 12:33:29 2026 +0100

    release_tests_devices.txt: Fix protectli vp6650 filename

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 2c21040937
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Mon Feb 16 12:32:22 2026 +0100

    BPS006: Add workaround for sudo-rs which is incompatible with ansible

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 468c722fca
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Mon Feb 16 12:30:23 2026 +0100

    linux-packages-playbook.yaml: accept gsettings modifications to fail

    will fail if Gnome is not installed (server OSes)

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 5df4832616
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Mon Feb 16 12:29:00 2026 +0100

    menus.robot: Add warning if OS not found and will try to boot the default disk

    Otherwise leads to cryptic fails failing because some disk name was not
    found, while the real culprit is the OS not being installed.

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 57a10e20ff
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Mon Feb 16 10:17:45 2026 +0100

    ci//pcengines-apu3_00252.json: Update device IP address

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 201c4b231a
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Mon Feb 16 09:44:22 2026 +0100

    keys-and-keywords/ubuntu-keywords.robot: Fix applying log level immediately

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit e6ed2a1adf
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Mon Feb 16 09:10:28 2026 +0100

    protectli-vp6650_00002.json: Update sonoff ip

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 4327625702
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Mon Feb 16 08:25:32 2026 +0100

    platform-configs/protectli: Reduce repeated DMIDECODE values

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 57ae4c7f56
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Mon Feb 16 08:10:05 2026 +0100

    ci//pcengines-apu3_00252.json: Fix FW file apu variant

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 6ee3180ee9
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Sat Feb 14 19:20:02 2026 +0100

    capsule-update.robot: Fix mismatch in waiting for tianocore string

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit ac70cd4b5e
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Sat Feb 14 14:45:57 2026 +0100

    capsule-update.robot: Make FUM screen optional, it depends on FW version

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 556c750018
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Sat Feb 14 14:45:20 2026 +0100

    lib/network.robot: Add sync on the end to prevent interrupting the file transfer

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 080a47375b
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Sat Feb 14 12:03:01 2026 +0100

    Revert "lib/network.robot: Rm target path before moving"

    This reverts commit 3bca42177f528f17eba13095dff0189a932fce8d.

commit d696e942dd
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Fri Feb 13 17:32:54 2026 +0100

    lib/network.robot: Rm target path before moving

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 45f892d25c
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Fri Feb 13 17:00:26 2026 +0100

    capsule_update_tests.sh: Remove only previous run files of the same name

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit d32f0be6d1
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Fri Feb 13 16:50:00 2026 +0100

    capsule-update.robot: Adjust for execution on both serial and ssh

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit fe86280f3c
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Fri Feb 13 15:26:02 2026 +0100

    capsule-update.robot: Restore FUM dialog handling when serial console supported

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 8c3377c627
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Fri Feb 13 11:36:49 2026 +0100

    keywords.robot: Login To Booted OS: Only attempt recover when via pure SSH

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 7909028153
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Fri Feb 13 10:17:18 2026 +0100

    keywords.robot: Fix Login To Linux With Root Priviledges doing nothing on serial

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit f0f79b38eb
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Fri Feb 13 09:34:29 2026 +0100

    lib/flash.robot: Increase response timeout after flash to 300s

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 7c31ddcfa2
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Fri Feb 13 09:09:13 2026 +0100

    msi-pro-690-a-wifi-ddr4_00039.json: change fw version to support custom logo

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit fb462a29ba
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Fri Feb 13 08:44:51 2026 +0100

    lib/dcu.robot: Prevent temp file collisions with uuids

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit da5a7d4865
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Fri Feb 13 08:34:25 2026 +0100

    requirements.txt: Bump osfv-scripts to fix time import

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit f4c7a10498
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Fri Feb 13 07:38:41 2026 +0100

    capsule-update.robot: Restore custom logo checking

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit cc4bd2981e
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Thu Feb 12 19:00:58 2026 +0100

    release_tests_suite_list*: Add Basic Platform Setup to release tests

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit a30afe2d55
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Thu Feb 12 18:42:54 2026 +0100

    capsule-update.robot: Remove redundant serial console test flow

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 73c3f50c4e
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Thu Feb 12 18:40:51 2026 +0100

    keyword & options-lib_dcu: Remove redundant Login To Windows keyword variant

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 870a899283
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Thu Feb 12 18:03:50 2026 +0100

    capsule-update.robot: Remove manual step from Flash Firmware If Not QEMU

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 12f0437d73
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Thu Feb 12 17:21:07 2026 +0100

    regression-scope/configs/devices: Add capsule update env vars

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 9a8b614abb
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Thu Feb 12 17:20:42 2026 +0100

    flash.robot: Flash FD using internal programmer to avoid FD mismatch bricks

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 1841da3665
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Thu Feb 12 17:19:15 2026 +0100

    novacustom-nuc_box.robot: Remove capsule update support: No capsules published

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 79efc50191
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Thu Feb 12 15:18:44 2026 +0100

    capsule-update.robot: Rework suite to work without additional manual setup steps

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit a89dae5b81
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Thu Feb 12 14:54:35 2026 +0100

    keywords.robot: Fix Login To Linux Via SSH not doing retries

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 7961884d86
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Thu Feb 12 14:54:05 2026 +0100

    lib/flash.robot: Increase timeouts a bit to compensate for large RAM training

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 68cf70bc11
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Thu Feb 12 13:30:38 2026 +0100

    lib/flash.robot: Flash ME in BTG supported devices

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit b75a681a80
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Thu Feb 12 13:30:00 2026 +0100

    keywords.robot: Load OS Credentials: Remove redundant OS login

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit e3b4f853c4
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Thu Feb 12 13:29:30 2026 +0100

    options-lib_dcu.robot: Remove redundant sleep in Set UEFI Option

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 738c518ca9
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Thu Feb 12 13:28:47 2026 +0100

    platform-configs: Update INTEL_CBNT_BOOTGUARD_FUSING_SUPPORT state

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 9c375275ba
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Thu Feb 12 13:27:12 2026 +0100

    lib/network.robot: Send File To DUT: check hashes, rm before send

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 1cc26c8c8a
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Thu Feb 12 13:26:09 2026 +0100

    lib/dcu.robot: Remove redundant sleep after flashing

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit c28a691773
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Thu Feb 12 12:57:14 2026 +0100

    Revert "TMP TEST: reduce trials for linux login"

    This reverts commit d41693da2a3a600beb7a4a26d95f6e7f90a2430a.

commit 31558818c9
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Thu Feb 12 10:51:33 2026 +0100

    capsule-update.robot: Flash rc0 before tests, update instructions

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit a93ad4dfc3
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 10 14:56:20 2026 +0100

    Login To* kwds: Add configurable retries amount for ssh variants

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 798f414c57
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 10 13:30:24 2026 +0100

    lib/flash.robot: Fix missing 'x' in Wait Unil KW Succeeds

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 5112388285
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 10 13:28:57 2026 +0100

    options-lib_dcu.robot: Boot System... Do not assume default_boot is the target

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit cd218ea212
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 10 13:03:46 2026 +0100

    Recover Broken Bootorder: resume login after recover

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 1ec4d06a06
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 10 13:01:19 2026 +0100

    Load OS Credentials: Create keyword for flaky repeated import

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 68c227185a
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 10 12:59:49 2026 +0100

    Set Nextboot Bootentry: Move implementation to lib/custom_boot_entries

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit e1617a7bb5
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 10 12:26:42 2026 +0100

    basic-platform-setup.robot: Normalize Boot&Login keyword variants usage in suite

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit e72ade0798
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 10 12:22:15 2026 +0100

    TMP TEST: reduce trials for linux login

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit b53c7638cb
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 10 12:15:55 2026 +0100

    Login To Windows Via SSH: Fail if login fails

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 43a852d863
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 10 09:55:58 2026 +0100

    linux-packages-playbook.yaml: Add systemwide update task

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 2bc0735e7a
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 10 09:55:11 2026 +0100

    BPS010: Deploy UEFI Shell: Add

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 6ea5a15f91
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 10 09:25:50 2026 +0100

    Ensure Custom Bootentry: fix indexing empty list

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 91b5b8f675
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 10 09:17:07 2026 +0100

    keywords.robot: Implement login to OS recovery

    When the boot order unexpectedly changes and testing via SSH,
    the whole regression will start failing.

    With this fallback, after we fail to log in to an OS, there
    will at least be the hope of recovering the regression
    eventually.

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 31d92cc5dc
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 10 09:01:06 2026 +0100

    Login To Windows Via SSH: Reduce login timeout from 1h@20 tries to 5m@5 tries

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit c97145ea33
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 10 09:34:58 2026 +0100

    fix login ssh timeouts

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit e25474b8b0
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 10 08:56:29 2026 +0100

    Login To Linux: Remove retrials of Login To Linux Via SSH

    Login To Linux Via SSH already retries all its code,
    so this is redundant and multiplies the wait time

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 2799ff26d4
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 10 08:35:46 2026 +0100

    Serial User Login Linux: Remove dead code

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 2200998119
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 10 08:33:11 2026 +0100

    Logint To Booted OS: Add keyword

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 6eb605d36e
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 10 08:28:58 2026 +0100

    Login To Windows: Add keyword

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 87a80967db
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 10 08:27:02 2026 +0100

    Login To Windows: Rename to Boot And Login To Windows

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit d76007a0a3
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 10 08:22:38 2026 +0100

    Login To OS: Rename to Boot And Login To OS

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 4b2acd2e51
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Mon Feb 9 17:22:30 2026 +0100

    os-specific-tasks/201.yml: Remove uefi shell installation

    it breaks bootorder and tests deploy it anyway

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 7d98f4d870
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Fri Feb 6 13:14:28 2026 +0100

    Deploy Uefi Shell: Ensure it doesnt break the bootorder

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

commit 1eda44fda0
Author: Filip Gołaś <filip.golas@3mdeb.com>
Date:   Tue Feb 3 13:32:10 2026 +0100

    osfv_stability_{run,reports}.py: Add

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

    osfv_stability_run: add release rules file

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

    osfv_stability_reports: add run count

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

    osfv_stability_reports: Fix: account for parallelism in total run time

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

    osfv_stability_run.py: accept env vars

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

    osfv_stability_reports.py: save logs to dirs depending on date and revision

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

    osfv_stability_run.py: Save results in paths per run date and rev

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

    osfv_stability_reports.py: Parse date, revision, branch and support json output

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

    osfv_stability_*.py: Allow configurable LOGS_DIR using env vars

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

    osfv_stability_reports.py: Handle broken robot xmls

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

    osfv_stability_reports.py: Unpack merged results

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

    osfv_stability_reports.py: Add suites to skip config

    Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-03-17 10:10:34 +01:00
Filip Gołaś a1a542fd5f Osfv stable release improvements (#1254)
* osfv_stability_{run,reports}.py: Add

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_run: add release rules file

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_reports: add run count

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_reports: Fix: account for parallelism in total run time

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_run.py: accept env vars

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_reports.py: save logs to dirs depending on date and revision

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_run.py: Save results in paths per run date and rev

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_reports.py: Parse date, revision, branch and support json output

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_*.py: Allow configurable LOGS_DIR using env vars

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_reports.py: Handle broken robot xmls

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_reports.py: Unpack merged results

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_reports.py: Add suites to skip config

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Deploy Uefi Shell: Ensure it doesnt break the bootorder

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* os-specific-tasks/201.yml: Remove uefi shell installation

it breaks bootorder and tests deploy it anyway

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Login To OS: Rename to Boot And Login To OS

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Login To Windows: Rename to Boot And Login To Windows

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Login To Windows: Add keyword

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Logint To Booted OS: Add keyword

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Serial User Login Linux: Remove dead code

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Login To Linux: Remove retrials of Login To Linux Via SSH

Login To Linux Via SSH already retries all its code,
so this is redundant and multiplies the wait time

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* fix login ssh timeouts

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Login To Windows Via SSH: Reduce login timeout from 1h@20 tries to 5m@5 tries

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* keywords.robot: Implement login to OS recovery

When the boot order unexpectedly changes and testing via SSH,
the whole regression will start failing.

With this fallback, after we fail to log in to an OS, there
will at least be the hope of recovering the regression
eventually.

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Ensure Custom Bootentry: fix indexing empty list

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* BPS010: Deploy UEFI Shell: Add

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* linux-packages-playbook.yaml: Add systemwide update task

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Login To Windows Via SSH: Fail if login fails

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* TMP TEST: reduce trials for linux login

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* basic-platform-setup.robot: Normalize Boot&Login keyword variants usage in suite

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Set Nextboot Bootentry: Move implementation to lib/custom_boot_entries

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Load OS Credentials: Create keyword for flaky repeated import

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Recover Broken Bootorder: resume login after recover

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* options-lib_dcu.robot: Boot System... Do not assume default_boot is the target

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* lib/flash.robot: Fix missing 'x' in Wait Unil KW Succeeds

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Login To* kwds: Add configurable retries amount for ssh variants

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* capsule-update.robot: Flash rc0 before tests, update instructions

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Revert "TMP TEST: reduce trials for linux login"

This reverts commit d41693da2a3a600beb7a4a26d95f6e7f90a2430a.

* lib/dcu.robot: Remove redundant sleep after flashing

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* lib/network.robot: Send File To DUT: check hashes, rm before send

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* platform-configs: Update INTEL_CBNT_BOOTGUARD_FUSING_SUPPORT state

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* options-lib_dcu.robot: Remove redundant sleep in Set UEFI Option

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* keywords.robot: Load OS Credentials: Remove redundant OS login

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* lib/flash.robot: Flash ME in BTG supported devices

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* lib/flash.robot: Increase timeouts a bit to compensate for large RAM training

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* keywords.robot: Fix Login To Linux Via SSH not doing retries

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* capsule-update.robot: Rework suite to work without additional manual setup steps

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* novacustom-nuc_box.robot: Remove capsule update support: No capsules published

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* flash.robot: Flash FD using internal programmer to avoid FD mismatch bricks

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* regression-scope/configs/devices: Add capsule update env vars

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* capsule-update.robot: Remove manual step from Flash Firmware If Not QEMU

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* keyword & options-lib_dcu: Remove redundant Login To Windows keyword variant

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* capsule-update.robot: Remove redundant serial console test flow

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* release_tests_suite_list*: Add Basic Platform Setup to release tests

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* capsule-update.robot: Restore custom logo checking

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* requirements.txt: Bump osfv-scripts to fix time import

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* lib/dcu.robot: Prevent temp file collisions with uuids

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* msi-pro-690-a-wifi-ddr4_00039.json: change fw version to support custom logo

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* lib/flash.robot: Increase response timeout after flash to 300s

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* keywords.robot: Fix Login To Linux With Root Priviledges doing nothing on serial

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* keywords.robot: Login To Booted OS: Only attempt recover when via pure SSH

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* capsule-update.robot: Restore FUM dialog handling when serial console supported

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* capsule-update.robot: Adjust for execution on both serial and ssh

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* capsule_update_tests.sh: Remove only previous run files of the same name

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* lib/network.robot: Rm target path before moving

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Revert "lib/network.robot: Rm target path before moving"

This reverts commit 3bca42177f528f17eba13095dff0189a932fce8d.

* lib/network.robot: Add sync on the end to prevent interrupting the file transfer

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* capsule-update.robot: Make FUM screen optional, it depends on FW version

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* capsule-update.robot: Fix mismatch in waiting for tianocore string

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* ci//pcengines-apu3_00252.json: Fix FW file apu variant

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* platform-configs/protectli: Reduce repeated DMIDECODE values

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* protectli-vp6650_00002.json: Update sonoff ip

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* keys-and-keywords/ubuntu-keywords.robot: Fix applying log level immediately

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* ci//pcengines-apu3_00252.json: Update device IP address

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* menus.robot: Add warning if OS not found and will try to boot the default disk

Otherwise leads to cryptic fails failing because some disk name was not
found, while the real culprit is the OS not being installed.

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* linux-packages-playbook.yaml: accept gsettings modifications to fail

will fail if Gnome is not installed (server OSes)

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* BPS006: Add workaround for sudo-rs which is incompatible with ansible

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* release_tests_devices.txt: Fix protectli vp6650 filename

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* novacustom-nu_box-155H_00254.json: Update device IP

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* msi-z690-common.robot: Change keyboard model to fit hardware matrix

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* uefi-shell.robot: Use library keywords to perform test

Otherwise it was failing on MSI z690.
It's always better to use common and working
keywords instead of reinventing the wheel.

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* osfv-test-data: Bump version

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* tpm-support.robot: Add missing skips for serial-only tests

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* verified-boot.robot: Run DCU locally to keep DUT from downloading containers

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* platform-configs/pcengines: Update dmidecode values

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* platform-configs/novacustom: Update dmidecode values

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* lib/dcu.robot: Put temp tiles in /tmp to prevent littering if cleanup fails

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* BPS006: Put temp tiles in /tmp to prevent littering if cleanup fails

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* lib/flash.robot: Read Firmware include ME and IFD

We might assume the read firmware contains some IFD
or ME later, not reading them would result in a brick
and doesn't increase the read time that much.

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* SSH Boot System: Always reinit connection to fix 'No open connections' errors

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* cpu-performance.robot: Limit test runs to 3

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* manual_cpu_performance.robot: Limit runs to 3

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* novacustom-v540tnd_00266.json: Update device ip

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* novacustom-nuc_box-155H_00254.json: Update device IP

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Login To Booted OS: Fix infinite recovery loop

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* release_tests_devices.txt: Remove nucbox

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* keywords.robot: Fix ssh_retries being passed as timeout

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* SSH Login keywords: Limit retries to 5m instead of fixed try count

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* release_tests_suite_list.txt: Remove duplicated __init__s

robot crashes otherwise

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* lib/prepare-platform.resource: Unify redundant Prepare Platform definitions

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* util/prepare-platform.robot: Add util test for running Prepare Platform

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* release_tests_suite_list.txt: Use util/prepare-platform instead of module inits

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* dts-lib.robot: Add semiauto test skip for flashing kwd

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* develop_pr_auto_regression.py: Only compare revs if files list not overridden

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* osfv_stability_run.py: Fix logs_base undefined on custom logs dir

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* scripts/ci/regression-scope: Preserve suites order

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* develop_pr_auto_regression.py: Fix orphan robot processes

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* release_tests_rules.json: Add automated tag filter

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* osfv_stability_reports.py: Add per-suite cache

For suites which take a long long time to process,
to not lose the time spent processing it if the
processing is interrupted

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* osfv_stability_reports.py: Differentiate run dates in caches and reports

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* release_tests_devices.tst: Revert using temporary desk setup devices

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* scripts/regression.sh: Fix scope change

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* cpu-performance: Fix FORCE_TIMES_TO_RUN envvar set command

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Login To Booted OS: Fix continuing on fail to login

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* test_cases.json: fix spelling and such (#1244)

* test_cases.json: fix spelling and such

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

test_cases.json: fix

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* test_cases.json: fixname

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* test_cases.json:remaining tests

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* test_cases.json: add WLE

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* check_tests_consistency.py: script lists diffs in test_cases.json and modules

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/*:fix

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* test_cases.json: fix

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

---------

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* test_cases.json: Add missing tests and fix changed_to's (#1246)

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* test_cases.json:fix net spd test (#1247)

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* docs/novacustom.md: document v0.9.0 downgrade bug

Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>

* docs/novacustom.md: add link to ec downgrade procedure

Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>

---------

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>
Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>
Co-authored-by: Wiktor Mówiński <wiktor.mowinski@3mdeb.com>
Co-authored-by: Michał Kopeć <michal.kopec@3mdeb.com>
2026-03-10 08:53:21 +01:00
Filip Gołaś ff66f5e963 Execute Reboot Command: Add delay for no-power-ctrl devices
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:08 +01:00
Filip Gołaś ba62812fb9 lib/utc.robot: stability fixes
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

lib/utc.robot: reboot tests add delay to prevent immediate re-login

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

lib/utc: hotplug tests: reorder disconnect/connect to end with connected

Otherwise the docking station would be left disconnected after
the tests causing further automated tests to possibly fail

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

UTC: Add dynamic skips for laptop semiautos

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:08 +01:00
Wiktor Mówiński e55342005e Qubesos tests (#1161)
* dasharo-compatibility/audio-subsystem.robot

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-performance/CPT_CPF_STB/203_qubesos.robot

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-performance/CPT_CPF_STB/203_qubesos.robot: fix CPF001 qubes

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/cpu-status.robot: cpu-status on qubes

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/cpu-status.robot: add new tests

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/usb-type-c.robot: update 2 tests

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-stability/nvme-detection.robot: add 4 tests

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-stability/m2-wifi.robot: add 4 manual tests

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* add more qubes tests

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* keywords.robot

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* platform-configs/novacustom-v540tu.robot: wip

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/ec-and-super-IO.robot: minor spelling mistakes

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/usb-hid-and-msc-support.robot: new test

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/usb-hid-and-msc-support.robot: add usb devices test

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/sd-card-reader.robot: port more qubes tests

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* keywords.robot: fix wip change

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* lib/sensors/sensors.robot

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/audio-subsystem.robot: remove tests that were not ready

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/ec-and-super-IO.robot: new test

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-stability/m2-wifi.robot: improve test instructions

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* test_cases.json: fix old ids

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* test_cases.json: add missing ecr

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* test_cases.json: add missing aud

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* test_cases.json: add missing cam

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* test_cases.json: add missing cpf,cup,dsp

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* test_cases.json: add missing sdc, smw, snv

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* test_cases.json: expand dictionary

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* test_cases.json: add remaining tests

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-stability/*: simplify instructions

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* platform-configs/include/default.robot remove superfluous flag

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* lib/sensors/sensors.robot: make qos compatible with other os tests

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* keywords.robot: revert debugging change

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/audio-subsystem/301_Windows.robot: grammar

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/cpu-status.robot: delete redundant skip

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/display-ports-and-lcd-support.robot: fix typo

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/*: fix typo

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/*: fix typos

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/usb-type-c.robot: remove crashing whitespaces

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/*: unravel login to os kwd

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/usb-type-c.robot: new qubes tests

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/usb-type-c.robot: fix inedts for Skip kwd

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/usb-type-c.robot: fix

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/usb-type-c.robot: save text in variable

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/display-ports-and-lcd-support.robot: fix id

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

---------

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>
2026-02-09 13:19:26 +01:00
Filip Gołaś 120f200c6d V560tnx v1.0.0 rc10 (#1202)
* .gitignore: Add _envvars, _roms directories

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* keywords.robot: Allow for the DUT ssh key to change when trying to connect via SSH in Login To Linux via SSH

* lib/tpm.robot: Check all PCRs before failing in Validate PCRs Against Event Log

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* miniPCIe-slot-verification: Skip LTE_CARD tests if card is not defined

* Stress Test Windows: use Execute Command In Terminal

Otherwise there is no timeout for the keyword and the
tests could hang forever

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* CBMEM001: Add semiauto implementation

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Set Nextboot Bootentry: compare strings as variables to fix utf decode errors

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* novacustom-mtl.robot: Add USB model t oconfig

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* novacustom-v560tne: v1.0.0-rc10 platform configs changes

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

novacustom-v560tne: Add windows support

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

v560tne: temp RTE serial tests

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

v560tne: dmidecode update version

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

v560tne: Restore fedora support flag

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

v560tne: Add USB drives model names for detection tests

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

v560tne: Add DOCKING_STATION_USB_C_CHARGING_SUPPORT

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

v560tne: add qubes support

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

v540tnd: Restore ubuntu default boot os

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

REMOVE platform-configs: restore SSH

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* acpi-driver.robot: Fix typo in deb package name

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* minipcie-slot-verification: Replace hardcoded wifi name with the configs

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Switch To Root User: Add workaround for passwordless root

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* os-specific-tasks/203.yml: Add qubesos ansible config

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* fwupd-support.robot: automate qubes

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* cpu-performance.robot: Add missing phoronix batch mode setup to automated suite

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Login To Windows Via SSH: Allow the key to change across retries

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Get Index Of Matching Option In Menu: do not use fuzzy match

It works a bit differently - the * is not a special character in
fuzzy search

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Execute Shutdown Command: Add linux systemd support

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

Execute Shutdown Command: Add some workaround for no power_led

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Measure Warmboot Time: add workaround for no RTC boot

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* platform-configs: Add RTC_BOOT_SUPPORT

https://github.com/Dasharo/open-source-firmware-validation/issues/1068

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* CBMEM suite: dynamic semiauto skips for no RTC boot support

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* network-interface-after-suspend: Add workaroud for no RTC boot

https://github.com/Dasharo/open-source-firmware-validation/issues/1068

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* linux-packages-playbook.yaml: Remove masking systemd suspend

It makes it impossible to suspend the device in conventional
ways like using the UI or via suspend key combination.
It has more cons that pros

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* cbnt.robot: Fix invalid ibg menu parsing

Due to confusing line wrapping in the menu the
state of the options following to the target
were being parsed

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* SBO: Fix test ids ENV_ID

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* fast-boot.robot: Increase wait time for systemd-analyze

50s was not always enough for bootup to finish.
150s should be better.

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* gpu-performance.robot: stability fixes

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

gpu-performance.robot: Fix string comparison error and x11 invalid display

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

gpu-performance.robot: Detect not running x11

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

gpu-performance.robot: Note that X11 is required

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

gpu-performance.robot: fix check for installed unigine-super

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

gpu-performance.robot: Add comment about display numbering bug

https://github.com/Dasharo/open-source-firmware-validation/issues/1215

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

lib/performance/common: Setup Phoronix: Upload results to openbenchmarking

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

disk-io.robot: Verify correct disk model before checking performance

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

disk-io.robot: move sleep to after skips to reduce unnecessary idle time

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* phoronix-test-suite tests: Cap run count to 3

Using:  FORCE_TIMES_TO_RUN env variable

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* lib/docs.robot: Increase time for docking station to init

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* util/fwupd-support-lvfs: stylistic changes

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

util/fwupd-support-lvfs: Remove unused variable

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

util/fwupd-support-lvfs.robot: Add missing newline in fwupd config

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* cbnt.robot: Remove newline characters from cbmem regex

The newline characters are not matched by this keyword.
Its matched line-by-line so newline characters
never appear

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* lib/utc.robot: stability fixes

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

lib/utc.robot: reboot tests add delay to prevent immediate re-login

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

lib/utc: hotplug tests: reorder disconnect/connect to end with connected

Otherwise the docking station would be left disconnected after
the tests causing further automated tests to possibly fail

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

UTC: Add dynamic skips for laptop semiautos

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* fwupd-support: Add --assume-yes to get-devices

First time its executed after a fwupd update it will prompt to send the
results to the vendor. It was not handled before.

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Execute Reboot Command: Add delay for no-power-ctrl devices

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* EXTERNAL_HEADSET: Change to list of acceptable values

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* BOOTED_OS_ID: Prevent resetting on new suite

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* warm/coldboot tests: Add dynamic semiauto skips if not supported

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* lib/robot.sh: Run all suites at once and split results later

We've made it so that the test suites are run separately so that
the logs can be organized neatly before.

Turns out that makes the state between suites get lost.
It's especially important for SSH tests which need to
always remember which OS is booted to use the correct
SSH credentials.

This commit changes this so that everything is run at once,
but the results are later parsed and split per-suite using
rebot.

An important thing to remember is that testers will often
interrupt the run using ctrl+c to get the test results
early and skip further execution. The change handles that
by trapping the INT signal and running the split
anyway.

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

lib/robot.sh: Move robot to fg instead of waiting

When running robot as a subprocess it wont receive the control
over stdin otherwise. Some semi-auto tests require user input
in terminal which will crash otherwise.

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

lib/robot.sh: fix detecting tags

tests that are fullauto on some and semi on some platforms
need to have both tags so that they are executed no matter
the `-i` param and the skips can take care of whether
the test is automated on given platform or not

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* TEST_TAGS: rename to INCLUDE_TAGS

Theres a builtin ${TEST TAGS}, but for some reason ${TEST_TAGS}
seems to be like an alias to it.

Our variable that keeps track of the tags requested by tester
needs to be changed because of that

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* options-lib_dcu: Set nextboot before Set UEFI Option

Set UEFI Option of options-lib_dcu reads the current
SMM Store, modifies it, and flashes it back.

If we set the Nextboot variable in SMM before reading
the SMM store it will stay after flash and reboot reducing
an unnecessary DEFAULT_BOOT_OS_ID boot.

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* sleep-lib.robot: warn on failed fwts sleep

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

sleep-lib: Add description of s3 test also working for s2idle(soix)

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* keywords.robot: Identify Path To USB: Fix returning TYPE instead of PATH

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* capsule-update.robot: Skip unnecessary setup when on ssh

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* scripts/lib/robot.sh & related: Restore old logs directory structure

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* audio-subsystem.robot: Delete old version of suite

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* platform-configs/include/protectli-vp66xx.robot: enable redundant boot

Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>

* coreboot-redundant-boot.robot: work with the new log convention

Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>

* platform-configs/include/protectli-vp66xx.robot: enable CBnT w/ status menu

Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>

* lib/bios/menus.robot: Parse Menu Snapshot Into Construction: drop fuzzy search

Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>

* platform-configs/include/protectli-vp66xx.robot: remove unused variable

Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>

* coreboot-redundant-boot.robot: RTC BUC Control Bit Should Be: don't convert case

Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>

* coreboot-redundant-boot.robot: parse log from current boot only

Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>

---------

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>
Co-authored-by: Michał Kopeć <michal.kopec@3mdeb.com>
2026-02-06 13:02:09 +01:00
Filip Gołaś 9db1f5a8a2 V540tnd v1.0.0 rc6 (#1082)
* requirements.txt: bump fuzzysearch

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* platform-configs: Use max_insertions and max_deletions in fuzzy telnet

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* [REMOVE ME] variables.robot: Add temporary desk RTE setup

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* platform-configs: Update supported OSes for v1.0.0-rc6

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* requirements.txt: bump osfv-scripts to include v56tnx models

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* novacustom-v560tu: Change Default boot to Ubuntu for faster tests

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Revert "novacustom-v560tu: Change Default boot to Ubuntu for faster tests"

This reverts commit 8cf1a77ccf.

* platform-configs: Update supported OSes for v1.0.0-rc6

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* novacustom-v540tu.robot: Test via SSH

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* novacustom-v540tu: set defaultboot to Ubuntu for quicker ubuntu tests

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* novacustom-v540tu: set defaultboot to Fedora

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* novacustom-v540tu: Add HDMI audio support

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* [REMOVE ME] novacustom-v540tu: temp disable flashing

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Revert "[REMOVE ME] novacustom-v540tu: temp disable flashing"

This reverts commit 87d12b871a.

* Revert "novacustom-v540tu: set defaultboot to Fedora"

This reverts commit 5e7be75c55.

* lib/docks.robot: longer delay for dock detection

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Ensure ME State: Check intead of set on first test

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Reapply "novacustom-v540tu: set defaultboot to Fedora"

This reverts commit 390b1eb00f.

* novacustom-v540tnd: prepare for ssh testsing

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* Revert "lib/docks.robot: longer delay for dock detection"

This reverts commit 39253fb02c.

* v560tnd.robot: Set defaultboot to ubuntu

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* novacustom-v540tnd: Add missing config vars

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* novacustom-common: Add CNB support

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* 201.yml: install python-is-python3

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* capsule-update.robot: Remove leftover checkout to pr branch

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* FAN: replace manual fwts execution with keyword

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* disk-io.robot: Fix misleading skip messages

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* capsule-update.robot: Increase timeout for preparing cup drive

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* prepare_capsule_update_tests_drive: Add -I to mkfs

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* CAM001.301: Loosen up camera detection

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* CUP: set tag semiauto for whole suite

The test suite is too problematic and requires manual preparations

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* cpu-frequency dont shut down on windows when SSH testing

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* novacustom-mtl: Remove POWER_MGMT_SUPPORT false to make it True

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* novacuston-v540tnd: default boot fedora

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* pre-commit fix

---------

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2025-11-04 16:43:15 +01:00
Filip Gołaś 8991ed3f7d V560tu v1.0.0 rc6 (#1117)
* requirements.txt: bump osfv-scripts to include v56tnx models

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* keywords.robot: Download File add acceptable response

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* keywords.robot: Download File remove --content-disposition

It was somehow causing the file to not download at all

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* keywords.robot: Download File remove check for saved - no longer true

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* acpi-driver.robot: Update dasharo-driver sensor name to be more generic

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* novacustom-v560tu.robot: Update wifi card name

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* novacustom-common: ACPI_CAMERA_SWITCH support

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* sleep-lib: FWTS suspend test: perform either s3 or s0idle test

Signed-off-by: Filip Goaś <filip.golas@3mdeb.com>

* novacustom-v560tu: Add missing USB_DEVICE

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* keywords.robot: Check Charing State: Accept Discharding as valid state

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* novacustom-v560tu: Update EXTERNAL_HEADSET

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* UTC: Remove SEMI_AUTO variable which duplicates semiauto tag

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* novacustom-v560tu: Add USB detectino support

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* novacustom-v560tu: Add KB detectino support

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* keywords.robot: Fix unterminated string error in Identify Path To USB

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* keywords.robot: Fix getting multiple match groups in Identify Path To USB

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* keywords.robot: Fix RF infexes lists from 0 in Identify Path To USB

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* options-lib_dcu: Set UEFI Option: Ensure a linux is booted

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* options-lib_dcu: Fix infinite recursion when returning from Windows

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* options-lib_dcu: Login To Windows: remove redundant sleep

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* lib/utc.robot: Ensure ME State - only boot to linux if state unknown/changed

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* */__init__.robot: Change Power Cycle On to Power On

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* fwupd-support: Add a fw missing qubes manual steps

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* keywords.robot: Execute Reboot Command save BOOTED_OS_ID as global

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* pre-commit fix

---------

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
Signed-off-by: Filip Goaś <filip.golas@3mdeb.com>
2025-11-04 16:31:59 +01:00
Filip Gołaś 3cf329f6cc lib/utc.robot: Ensure ME State - make sure to return to Linux
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2025-08-29 10:54:48 +02:00
Maciej Pijanowski d11aed8d50 tree-wide: drop robot:private tag
It produces lot's of warning with little benefit. Must be disabled
until it works proparly, if at all.

Related issue:
https://github.com/Dasharo/open-source-firmware-validation/issues/966

Signed-off-by: Maciej Pijanowski <maciej.pijanowski@3mdeb.com>
2025-08-19 16:12:08 +02:00
Maciej Pijanowski 2bd2e50c9b robocop: enable ReplaceWithVAR formatter
Signed-off-by: Maciej Pijanowski <maciej.pijanowski@3mdeb.com>
2025-07-29 10:41:24 +02:00
Michał Iwanicki 6259957d27 Add DTS initial deployment & Heads transition tests (#860)
* DTS010.001: Add initial deployment test

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* README.md: fix hyperlink

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* pre-commit: Update robocop to 5.8.0

Previous version had problems with variable capitalization
To update to 6.3.0 we will need to migrate config and fix
requirements.txt dependencies as robotframework-sherlock requires
pathspec 0.9.* while robocop at least 0.12.0. Unless we don't have to
keep pre-commit and venv tools synced

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dasharo-tools-suite: make update/deployment work automatically and manually

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dts-lib: add keyword that allows waiting for multiple checkpoints

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* pre-commit: fix robocop errors

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dasharo-tools-suite: Use different var for update/deploy

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dasharo-tools-suite: Add heads transition

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dasharo-tools-suite: Add missing checkpoint wait

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dasharo-tools-suite: Add seabios deployment

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dts-lib: fix bug in keyword

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* odroid-h4-plus: add DTS support

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dasharo-tools-suite: enable network boot in tests not in suite

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dasharo-tools-suite: free serial connection on manual step

This allows us to connect to DUT via serial and do manual steps if
needed. Also added couple small fixes in 'Flash FW Automatically Or
Manually' so it works correctly

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dasharo-tools-suite: enable log sending when updating/deploying

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dasharo-tools-suite: set SeaBIOS to True when deploying SeaBIOS

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dasharo-tools-suite: return DPP SeaBIOS when deploying SeaBIOS

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dts-lib: remove "" from starting regexp

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dasharo-tools-suite: enable ssh server automatically and start dts-boot

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dasharo-tools-suite: remove redundant Power On

'Make Sure That Network Boot Is Enabled' doesn't have any requirements
before using it so 'Power On' isn't needed.

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dasharo-tools-suite & dts-lib: increase timeouts

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

---------

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>
2025-06-12 12:17:23 +02:00
Filip Gołaś 8d149f4615 lib/utc: Separate display detect tests on dp-alt or thunderbolt support
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2025-04-16 16:04:20 +02:00
Filip Gołaś 5b8de73bf6 lib/utc.robot: Usb Type-C Display Output: Remove redundant ME check
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2025-04-16 16:04:20 +02:00
Filip Gołaś 320fac0fcd lib/utc: Ensure ME State: Check the actual ME state
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2025-04-16 16:04:19 +02:00
Filip Gołaś 017d6c7f20 lib/utc.robot: Add library with UTC tests implementation
UTC test suite is generated automatically using a script.
It is already over 3k lines in size.
The generic keywords that implement the test cases, which
(currently) repeat up to 18 times during the test suite
were moved to a library, so that the test suite can remain
fully automatically generated.

The keyword implementations are based on, and mostly just
copies of the implementations from the old versions of
the UTC test case.

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2025-04-16 16:04:19 +02:00