Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
regresion-scope/configs: Add DEVICE_IP
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
regression-scope/configs/devices: Add FW files paths
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
protectli-vp66t0_00004.json: Add sonoff_ip for a good measure
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
novacustom-v540tu_00191.json: Update device ip
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
release_tests_devices.csv: Add novacustom MTL instead of ADL
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
regression-scope/configs/devices: csv->txt
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
osfv_stability_run: add release rules file
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
osfv_stability_reports: add run count
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
osfv_stability_reports: Fix: account for parallelism in total run time
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
osfv_stability_run.py: accept env vars
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
osfv_stability_reports.py: save logs to dirs depending on date and revision
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
osfv_stability_run.py: Save results in paths per run date and rev
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
osfv_stability_reports.py: Parse date, revision, branch and support json output
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
osfv_stability_*.py: Allow configurable LOGS_DIR using env vars
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
osfv_stability_reports.py: Handle broken robot xmls
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
osfv_stability_reports.py: Unpack merged results
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
osfv_stability_reports.py: Add suites to skip config
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
scripts/ci/develop_pr_auto_regression: Respect snipeit
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
develop_pr_auto_regression.py: Express max snipeit timeout in seconds not tries
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
develop_pr_auto_regression.py: Cap for exponential backoff + increase to ~5h
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
bash supervisor fixed
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
develop_pr_auto_regression.py: filter out comments from devices file
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
develop_pr_auto_regression.py: remove forced BPS, make it just a test in scope
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
develop_pr_auto_regression.py: Accept max snipeit timeout as env variable
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
develop_pr_auto_regression.py: if only single job was run, return its RC
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
* CPT_CPF_STB/201.robot: Add missing test variants
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
* CPT_CPF_STB: Fix measurement loop 0s iteration timer bug
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
* CPT_CPF_STB/common.robot: Do not gather data for skipped tests
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
* test_cases.json: Add missing tests from robot files
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
* test_id_checking_lib.py: Only compare test IDs when looking for missing tests
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
* .pre-commit-config.yaml: Add missing dependencies of broken robocop hooks
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>
---------
Signed-off-by: Filip Gołaś <filip.golas@3mdeb.com>