Commit Graph

233 Commits

Author SHA1 Message Date
Wiktor Mowinski
756ed62402 check_tests_consistency.py: script lists diffs in test_cases.json and modules
Signed-off-by: Wiktor Mowinski <wiktor.mowinski@3mdeb.com>
2026-02-19 13:05:30 +01:00
Filip Gołaś
35d7c64526 devices/protectli-vp6650_00004.json: Fix filename, asset id is 00002
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:10 +01:00
Filip Gołaś
64a1f97770 osfv_stability_run.py: Fix subsequent runs going into previous ones
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:10 +01:00
Filip Gołaś
fc3b0c07bc osfv_stability_run.py: Do not exit early on single run failure
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:10 +01:00
Filip Gołaś
370c5b1190 regression-scope/configs/devices: replace nucbox and v540tu
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:10 +01:00
Filip Gołaś
68b82fcce9 precommit
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:10 +01:00
Filip Gołaś
698111849f osfv_stability_run.py: Remove unused const
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:10 +01:00
Filip Gołaś
21e4e80e14 osfv_stability_reports.py: Add tqdm progress bars
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:09 +01:00
Filip Gołaś
4b64c59ff0 basic_platform_setup_ci_list.txt: Add
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:09 +01:00
Filip Gołaś
81144456ce rebot_splitter.py: Handle broken robot xmls
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:09 +01:00
Filip Gołaś
0aaa9b1bc8 release_tests_suite_list.txt: Add a real-deal list
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

release_tests_suite_list.txt: Add full and minimal list

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:09 +01:00
Filip Gołaś
f28a5cf5a8 osfv_regression_scope.py: Parse commets when reading test list
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:09 +01:00
Filip Gołaś
e8dbc91f5b requirements.txt: Add tqdm
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:09 +01:00
Filip Gołaś
84af21dabf pre-commit
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:09 +01:00
Filip Gołaś
b9460a5f0e regression-scope/configs/devices: Add device configs for regression runs
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

regresion-scope/configs: Add DEVICE_IP

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

regression-scope/configs/devices: Add FW files paths

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

protectli-vp66t0_00004.json: Add sonoff_ip for a good measure

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

novacustom-v540tu_00191.json: Update device ip

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

release_tests_devices.csv: Add novacustom MTL instead of ADL

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

regression-scope/configs/devices: csv->txt

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:09 +01:00
Filip Gołaś
793ae5b359 osfv_stability_{run,reports}.py: Add
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_run: add release rules file

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_reports: add run count

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_reports: Fix: account for parallelism in total run time

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_run.py: accept env vars

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_reports.py: save logs to dirs depending on date and revision

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_run.py: Save results in paths per run date and rev

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_reports.py: Parse date, revision, branch and support json output

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_*.py: Allow configurable LOGS_DIR using env vars

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_reports.py: Handle broken robot xmls

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_reports.py: Unpack merged results

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

osfv_stability_reports.py: Add suites to skip config

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:08 +01:00
Filip Gołaś
5368becd66 regression_scope_selftests: Adjust to simpler configs
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

rules-new.json: remove trash file

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:08 +01:00
Filip Gołaś
553bee322a scripts/ci/regression-scope: Reduce unnecessary config options
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

simplification

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:08 +01:00
Filip Gołaś
c3c7f9cc1d develop_pr_auto_regression: rewrite in python
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

scripts/ci/develop_pr_auto_regression: Respect snipeit

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

develop_pr_auto_regression.py: Express max snipeit timeout in seconds not tries

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

develop_pr_auto_regression.py: Cap for exponential backoff + increase to ~5h

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

bash supervisor fixed

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

develop_pr_auto_regression.py: filter out comments from devices file

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

develop_pr_auto_regression.py: remove forced BPS, make it just a test in scope

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

develop_pr_auto_regression.py: Accept max snipeit timeout as env variable

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

develop_pr_auto_regression.py: if only single job was run, return its RC

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:08 +01:00
Filip Gołaś
b8f413b9dd osfv-regression-scope.py: Allow predefined tests list instead of smart scope
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:08 +01:00
Filip Gołaś
8af4975813 scripts/lib/robot.sh & related: Restore old logs directory structure
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-13 13:55:08 +01:00
Filip Gołaś
0592f5687d V560tu v1.0.1 rc2 (#1172)
* CPT_CPF_STB/201.robot: Add missing test variants

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* CPT_CPF_STB: Fix measurement loop 0s iteration timer bug

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* CPT_CPF_STB/common.robot: Do not gather data for skipped tests

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* test_cases.json: Add missing tests from robot files

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* test_id_checking_lib.py: Only compare test IDs when looking for missing tests

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

* .pre-commit-config.yaml: Add missing dependencies of broken robocop hooks
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>

---------

Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
2026-02-12 09:39:46 +01:00
Michał Kopeć
70039ff75a scripts/capsules: upload BTG capsule if needed
Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>
2026-02-10 09:42:30 +01:00
Michał Kopeć
4854cef3bb scripts/capsules/prepare_capsule_update_tests_drive.sh: copy BTG testing capsule
Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>
2026-02-10 09:42:30 +01:00
Michał Kopeć
2fecccc819 dasharo-stability/capsule-update.robot: Add BtG popup test
Signed-off-by: Michał Kopeć <michal.kopec@3mdeb.com>
2026-02-10 09:40:30 +01:00