Commit Graph

68 Commits

Author SHA1 Message Date
Michał Iwanicki
17f8d3467b zarhus-x86: provisioning: add 'zarhus provision' checksum tests
Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>
2026-01-29 16:56:26 +01:00
Filip Gołaś
e33b1445f3 pre-commit fix 2025-11-05 09:54:43 +01:00
Filip Gołaś
d132a538c3 concurrent-tests.md: languagetool 2025-11-05 09:54:43 +01:00
Filip Gołaś
9485d72b53 docs: Add concurrent testing guide 2025-11-05 09:54:43 +01:00
Michał Iwanicki
d1e59d757c docs: zarhus-tests: Add documentation related to Zarhus OS testing
Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>
2025-10-23 14:38:25 +02:00
Filip Gołaś
de95b72764 adding-new-platforms.py: Update with helper scripts
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2025-09-26 16:58:08 +02:00
Michał Iwanicki
68f2a09044 docs: dts-tests: add required dts_config_ref variable (#1063)
Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>
2025-09-08 17:46:53 +02:00
Michał Iwanicki
75cd10c1ba Add dts profile diff (#999)
* dts-e2e: add workflow profiles

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dts-e2e: modify platform configs so they reflect real workflows

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dts-e2e: modify e2e tests to verify profile at the end

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dts: add tests to generate profiles on real platforms

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* flash.robot: use INTERNAL_PROGRAMMER_CHIPNAME with quotes

Otherwise it will fail if chipname contains space

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* network.robot: Allow optional hash verification in 'Get File From DUT'

This allows us to use this keyword with globs to get multiple files from DUT

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* network.robot: Try to use 'ip a' to get IP if 'hostname -I' fails

On DTS 'hostname' command doesn't have 'I' argument

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* ipxe-run.sh: remove root=/dev/nfs to fix dnf install

With this argument installing DTS extensions fails as dnf thinks there
is not enough free space on rootfs

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* docs: dts-tests.md: split long robot command into multiple lines

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

---------

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>
2025-08-27 15:38:21 +02:00
Mateusz Maciejewski
ae2ff0a1d1 ESXi (4xx) & BSD (5xx) environment IDs added to docs/
Signed-off-by: Mateusz Maciejewski <mateusz.maciejewski@3mdeb.com>
2025-08-19 12:25:55 +02:00
artur-rs
9e3b9cba1f dts/dts-e2e.robot: export DTS_CONFIG_REF from env (#993)
* dts/dts-e2e.robot: export DTS_CONFIG_REF from env

Signed-off-by: Artur Raglis <artur.raglis@3mdeb.com>

* dts/dts-e2e.robot: use global variable dts_config_ref

Signed-off-by: Artur Raglis <artur.raglis@3mdeb.com>

* docs/dts-tests.md: add dts_config_ref variable guide

Signed-off-by: Artur Raglis <artur.raglis@3mdeb.com>

* lib/dts-lib.robot: dts_config_ref_value unique name and default values

Signed-off-by: Artur Raglis <artur.raglis@3mdeb.com>

---------

Signed-off-by: Artur Raglis <artur.raglis@3mdeb.com>
2025-08-06 16:47:13 +02:00
Michał Iwanicki
07cf214e4b Add templated DTS E2E tests (#863)
* dts: Add TemplateSplit and PlatformParser libraries

* TemplateSplit - split each template keyword into separate tests
* PlatformParser - parse platform config and return variables defined
  for that platform in a dict

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* requirements.txt: update to robotframework 7.3

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dts: replace tests with template generated ones

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dts-lib: remove unused keyword

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dts-lib: Add some improvements and new keywords

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* platform-configs: add config used with templated E2E tests

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dts: dts-e2e: review fixes

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dts-e2e: pre-commit fixes

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dts-e2e: fix email in spdx and remove requirements-rf7.txt

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dts-e2e: change subscription to release

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dts-e2e: Set default version for every workflow

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dts-e2e: docs: add templated test documentation

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

* dts-e2e: novacustom-nuc_box doesn't support any DTS workflows yet

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>

---------

Signed-off-by: Michał Iwanicki <michal.iwanicki@3mdeb.com>
2025-08-01 12:08:55 +02:00
Filip Lewiński
fdc05b63a6 docs/novacustom.md: reference guide on USB serial setup on Ubuntu
Signed-off-by: Filip Lewiński <filip.lewinski@3mdeb.com>
2025-07-17 10:29:46 +02:00
Wiktor Mówiński
e754ce4ee3 Test tags (#914)
* dasharo-compatibility/*: add auto/semiauto tags to dasharo compatibility

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-security/*: add auto/semiauto tags to dasharo security

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-performance/*: add auto/semiauto tags to dasharo performance

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-stability/*: add auto/semiauto tags to dasharo stability

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* scripts/regression.sh: run only automated tests during regression run

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* scripts/regression.sh: revert debug changes

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-: use default tags

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-: double tagged minimalregression

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/dasharo-tools-suite.robot: set default tag for dtts suite

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/display-ports-and-lcd-support.robot: use default tag

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/dasharo-tools-suite.robot: mark test as semiauto

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-compatibility/audio-subsystem.robot: add tag semiauto

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* dasharo-security/tpm-support.robot: add missing automated tag

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

* docs/adding-and-naming-test-cases.md: tags guidelines

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>

---------

Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>
2025-07-10 15:54:48 +02:00
Filip Gołaś
49d5c327f0 docs/adding-and-naming-test-cases: Note on test ID CI
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2025-07-10 12:09:26 +02:00
Jakub Redmerski
b386b9c706 cpu-throttling.robot change: test case IDs and test names
Signed-off-by: Jakub Redmerski <jakub.redmerski@3mdeb.com>
2025-06-24 14:13:31 +02:00
Krystian Hebel
d0427ffe76 docs/adding-and-naming-test-cases.md: add example for Previous IDs
Signed-off-by: Krystian Hebel <krystian.hebel@3mdeb.com>
2025-06-16 17:16:19 +02:00
Krystian Hebel
94afd8480b docs/adding-and-naming-test-cases.md: fix environment-test-ids name
Signed-off-by: Krystian Hebel <krystian.hebel@3mdeb.com>
2025-06-16 17:16:19 +02:00
Krystian Hebel
b18a804194 scripts/list-tests-from-{json,robot}.sh: add new scripts
Can be used to check whether test cases in source files and their
copy in `test_cases.json` are in sync.

Signed-off-by: Krystian Hebel <krystian.hebel@3mdeb.com>
2025-06-16 17:16:16 +02:00
Krystian Hebel
df68bf4cab docs/adding-and-naming-test-cases.md: add invocation of synchronize-db.py
Signed-off-by: Krystian Hebel <krystian.hebel@3mdeb.com>
2025-06-13 13:21:59 +02:00
Krystian Hebel
0f284d62eb docs/adding-and-naming-test-cases.md: renamed from tests-naming-convention.md
Also described JSON in more detail, and linked to this document from
the main README.

Signed-off-by: Krystian Hebel <krystian.hebel@3mdeb.com>
2025-06-13 13:21:57 +02:00
Krystian Hebel
8230ed074f docs/tests-naming-convention.md: mention synchronize-db.py
Signed-off-by: Krystian Hebel <krystian.hebel@3mdeb.com>
2025-06-02 16:56:24 +02:00
Krystian Hebel
be28410049 test_cases.json: add new file for synchronization with database
The file was obtained with the following command:

curl http://user:password@<DB-IP>:<DB-PORT>/test_cases/_all_docs?include_docs=true \
    | jq '[.rows[] | select(.doc._id | startswith("_design") | not) | del(.doc._rev) | pick(.doc)]' \
    > test_cases.json

Since the synchronization is expected to work in the other direction
(from this repository towards the database) the command shouldn't be
required anymore, but is left for completeness.

Signed-off-by: Krystian Hebel <krystian.hebel@3mdeb.com>
2025-06-02 16:56:23 +02:00
Filip Gołaś
710137c0cb docs/tests-naming-convention: Add note to leave the old ID in comment
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2025-06-02 16:55:51 +02:00
Wiktor Mowinski
1feb380810 docs/contributing.md: robot framework test development guidelines
Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>
2025-05-20 17:08:56 +02:00
Filip Lewiński
a749fc30b8 pre-commit fix
Signed-off-by: Filip Lewiński <filip.lewinski@3mdeb.com>
2025-04-23 12:52:10 +02:00