mirror of
https://github.com/token2/snapd.git
synced 2026-03-13 11:15:47 -07:00
master
57 Commits
| Author | SHA1 | Message | Date | |
|---|---|---|---|---|
Sergio Cazzolato
|
52913814cc |
Squashed 'tests/lib/external/snapd-testing-tools/' changes from 1c8efb77e1..cdf5cfd47b (#14157)
cdf5cfd47b Remove centos-7 support f3996cc3fa change the spread label 1e309f41c6 change how legacy parameter is determine in remote.pull c43c35f7e3 run remote refresh and wait-for for xenial (skip bionic) 5262d30da7 make sure the test jobs are executed in runners with the spread label cb74259b7a add openstack systems 0b41fd40d3 fix tests.pkgs on arch-linux 558e109793 run fedora-40 spread tests in openstack 6f6187416d fix list implementation b4a5439c9b added more type annotatios to log_helper 58da1e36c3 mypy cleaned 1ff651e680 update wording of remote.pull 18615b1667 just usc scp -O when ssh version is -ge 9 cc68c9868b Added type annotations for log-filter 66f90d10cd Adding -O to scp command to make it compatible in uc24 tests 496cb7b5b3 removing support for centos-8 f2eef30db4 Updated the log helper and log parser 5a375ebf73 Formatting for python utils d3eed3faa5 fix codespell in CODE_OF_CONDUCT.md 18bcca6b14 new log helper d60381fcd9 add run number to filtered filename 5dde2d67b8 consider the tests execution in main 6b9a3aabcc change filtered log name b2756aa579 default file is .filtered.log 500b9dace4 Fix tests workflow 45db26a3d2 fix shellcheck error in log-filter fe45c27b7d create a var to store filter params 5a9b66d7dc filter spread results 51f9b055af New tool used to filter the spread.log output b8d20c1d5b fix snaps.name test with correct siffix spelling f640ac72e3 Add missing test details f0754df304 Filter the error y debug output in log-parser fc10196efd Add suggestions to details 94ac5ffe58 Add details on tests 501578c719 add more checks in os.query to check is-core_xx e8929207ff fix os-query for ubuntu comparing with core 226114641f os.query won't check SPREAD_SYSTEM anymore to compare core systems b89ec98b23 use local variables in os.query tool dacfd81de9 fix is_core functions 1db5214d5f Improve the remote docs (#36) 2e4a3153a2 1 more comment 3a0fc57e1e add explanation about why we check for ( Do | Doing ) 4cf8e635bf fix os.query test after merge b89b4f8647 fix artifacts name d30cee6da0 Merge remote-tracking branch 'upstream/main' 5ef5dcbe8f Tests use artifacts in spread tests (#51) 555c43d2ab Support auto-refresh with Do instead of Doing 96c2b0c19c remove tests support for ubuntu 23.04 (EoL) 74082c0c34 Tests improve remote wait (#49) 5121bfb659 remove support for opensuse leap 15.4 (#48) 30df700d08 Add new systems support (#47) 1f08938925 Support check amazon linux version (#46) 43533bdd97 Change the exit value checking for test formats (#45) 3c88244c04 Update check-test-format to support a dir and a list of files (#44) 510d95f429 add extra check for error in auto-refresh detection function 3289d4031b Try open the log with latin-1 encoding when utf-8 is not working 9db785499f improved how the tools are waiting for system reboot 2a5c4414a3 fix shellcheck errors 5e7b63883d Fixes for osquery and tests pkgs (#43) 4c9145e2ac support reboot waiting for auto-refresh 45768f5188 show changes in unknown status after refresh 8013c30c2a Remove support for ubuntu 22.10 b32b80bf54 Fix remote.rait-for test in bionic 5675c625e9 Enable fedora 38 55f4471957 Support for new oss f2e88b357c New tool used to query spread json reports cacd35ede0 utils/spread-shellcheck: explain disabled warnings (#42) c82afb2dee Support --no-install-recommends parameter when installing dependencies with tests.pkgs b84eea92e2 spread-shellcheck: fix quotes in environment variables (#41) ab1e51c29f New comparison in os-query for core systems (#40) e5ae22a5d4 systemd units can be overwritten 63540b845a Fix error messages in remote pull and push 75e8a426a5 make sure the unit is removed in tests.systemd test 9089ff5c02 Update tests to use the new tests.systemd stop-unit 44ecd5e56a Move tests.systemd stop-units to stop-unit 01a2a83b4b Update tests.systemd to have stop units as systemd.sh 162e93bd35 update tests.systemd CLI options to be the same than retry command 14aa43a405 new feature to re-run failed spread tests (#39) 604cb782db Fix shellcheck in systemd tool bfc71082c8 Update the tests.systemd to allow parameters waiting for service status 8a2d0a99df Adding quiet tool and removing set +-x from tests.pkgs d90935d2a4 A comment explaining about the default values for wait-for 3232c5dba7 Add support for ubuntu 23.04 a7164fba07 remove fedora 35 support, add fedora 37 support 89b9eb5301 Update systems supported 92bb6a0664 Include snap-sufix in the snaps.name tool git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: cdf5cfd47b4b9d528ab4544c1d6900dec797fbf2 |
||
|
Sergio Cazzolato
|
f40b9595a1 |
tests: remove centos 7 support (#14147)
* tets: remove support for centos-7 Centos-7 is EOL since June-30 Signed-off-by: Sergio Cazzolato <sergio.cazzolato@canonical.com> * update the release_tst.go with the real centos 9 info --------- Signed-off-by: Sergio Cazzolato <sergio.cazzolato@canonical.com> |
||
|
Sergio Cazzolato
|
3f5225c2aa |
tests: new spread log utils (#14062)
* Squashed 'tests/lib/external/snapd-testing-tools/' changes from 1c8efb77e1..496cb7b5b3 496cb7b5b3 removing support for centos-8 f2eef30db4 Updated the log helper and log parser 5a375ebf73 Formatting for python utils d3eed3faa5 fix codespell in CODE_OF_CONDUCT.md 18bcca6b14 new log helper d60381fcd9 add run number to filtered filename 5dde2d67b8 consider the tests execution in main 6b9a3aabcc change filtered log name b2756aa579 default file is .filtered.log 500b9dace4 Fix tests workflow 45db26a3d2 fix shellcheck error in log-filter fe45c27b7d create a var to store filter params 5a9b66d7dc filter spread results 51f9b055af New tool used to filter the spread.log output b8d20c1d5b fix snaps.name test with correct siffix spelling f640ac72e3 Add missing test details f0754df304 Filter the error y debug output in log-parser fc10196efd Add suggestions to details 94ac5ffe58 Add details on tests 501578c719 add more checks in os.query to check is-core_xx e8929207ff fix os-query for ubuntu comparing with core 226114641f os.query won't check SPREAD_SYSTEM anymore to compare core systems b89ec98b23 use local variables in os.query tool dacfd81de9 fix is_core functions 1db5214d5f Improve the remote docs (#36) 2e4a3153a2 1 more comment 3a0fc57e1e add explanation about why we check for ( Do | Doing ) 4cf8e635bf fix os.query test after merge b89b4f8647 fix artifacts name d30cee6da0 Merge remote-tracking branch 'upstream/main' 5ef5dcbe8f Tests use artifacts in spread tests (#51) 555c43d2ab Support auto-refresh with Do instead of Doing 96c2b0c19c remove tests support for ubuntu 23.04 (EoL) 74082c0c34 Tests improve remote wait (#49) 5121bfb659 remove support for opensuse leap 15.4 (#48) 30df700d08 Add new systems support (#47) 1f08938925 Support check amazon linux version (#46) 43533bdd97 Change the exit value checking for test formats (#45) 3c88244c04 Update check-test-format to support a dir and a list of files (#44) 510d95f429 add extra check for error in auto-refresh detection function 3289d4031b Try open the log with latin-1 encoding when utf-8 is not working 9db785499f improved how the tools are waiting for system reboot 2a5c4414a3 fix shellcheck errors 5e7b63883d Fixes for osquery and tests pkgs (#43) 4c9145e2ac support reboot waiting for auto-refresh 45768f5188 show changes in unknown status after refresh 8013c30c2a Remove support for ubuntu 22.10 b32b80bf54 Fix remote.rait-for test in bionic 5675c625e9 Enable fedora 38 55f4471957 Support for new oss f2e88b357c New tool used to query spread json reports cacd35ede0 utils/spread-shellcheck: explain disabled warnings (#42) c82afb2dee Support --no-install-recommends parameter when installing dependencies with tests.pkgs b84eea92e2 spread-shellcheck: fix quotes in environment variables (#41) ab1e51c29f New comparison in os-query for core systems (#40) e5ae22a5d4 systemd units can be overwritten 63540b845a Fix error messages in remote pull and push 75e8a426a5 make sure the unit is removed in tests.systemd test 9089ff5c02 Update tests to use the new tests.systemd stop-unit 44ecd5e56a Move tests.systemd stop-units to stop-unit 01a2a83b4b Update tests.systemd to have stop units as systemd.sh 162e93bd35 update tests.systemd CLI options to be the same than retry command 14aa43a405 new feature to re-run failed spread tests (#39) 604cb782db Fix shellcheck in systemd tool bfc71082c8 Update the tests.systemd to allow parameters waiting for service status 8a2d0a99df Adding quiet tool and removing set +-x from tests.pkgs d90935d2a4 A comment explaining about the default values for wait-for 3232c5dba7 Add support for ubuntu 23.04 a7164fba07 remove fedora 35 support, add fedora 37 support 89b9eb5301 Update systems supported 92bb6a0664 Include snap-sufix in the snaps.name tool git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 496cb7b5b3c160dc86e84fb7adca3bd5c862e88e * log-parser does not support anymore --print-detail * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 496cb7b5b3..cc68c9868b cc68c9868b Added type annotations for log-filter 66f90d10cd Adding -O to scp command to make it compatible in uc24 tests git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: cc68c9868bcc504497e0a8e459810c8ca2aa0c8d * Squashed 'tests/lib/external/snapd-testing-tools/' changes from cc68c9868b..18615b1667 18615b1667 just usc scp -O when ssh version is -ge 9 git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 18615b1667b6f292d29333f34a973938a28c0e7b * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 18615b1667..1ff651e680 1ff651e680 update wording of remote.pull git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 1ff651e6804b32184f7b62f9492c58d95a397cc1 * Update tests/lib/external/snapd-testing-tools/tests/remote.retry/task.yaml Co-authored-by: Zygmunt Bazyli Krynicki <me@zygoon.pl> * fix merge issue * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 1ff651e680..58da1e36c3 58da1e36c3 mypy cleaned git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 58da1e36c3c95398af5b2111ebcef87eebb7bd46 * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 58da1e36c3..b4a5439c9b b4a5439c9b added more type annotatios to log_helper git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: b4a5439c9bd31f11f7fa08515a8142b399fcbcc8 * Squashed 'tests/lib/external/snapd-testing-tools/' changes from b4a5439c9b..6f6187416d 6f6187416d fix list implementation git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 6f6187416da05d9b6799c10bfb6534085a13524b --------- Co-authored-by: Zygmunt Bazyli Krynicki <me@zygoon.pl> |
||
|
Sergio Cazzolato
|
f94c3fce86 |
tests: more details in spread tests - part 14 (#13926)
* Squashed 'tests/lib/external/snapd-testing-tools/' changes from 1c8efb77e1..f640ac72e3 f640ac72e3 Add missing test details f0754df304 Filter the error y debug output in log-parser fc10196efd Add suggestions to details 94ac5ffe58 Add details on tests 501578c719 add more checks in os.query to check is-core_xx e8929207ff fix os-query for ubuntu comparing with core 226114641f os.query won't check SPREAD_SYSTEM anymore to compare core systems b89ec98b23 use local variables in os.query tool dacfd81de9 fix is_core functions 1db5214d5f Improve the remote docs (#36) 2e4a3153a2 1 more comment 3a0fc57e1e add explanation about why we check for ( Do | Doing ) 4cf8e635bf fix os.query test after merge b89b4f8647 fix artifacts name d30cee6da0 Merge remote-tracking branch 'upstream/main' 5ef5dcbe8f Tests use artifacts in spread tests (#51) 555c43d2ab Support auto-refresh with Do instead of Doing 96c2b0c19c remove tests support for ubuntu 23.04 (EoL) 74082c0c34 Tests improve remote wait (#49) 5121bfb659 remove support for opensuse leap 15.4 (#48) 30df700d08 Add new systems support (#47) 1f08938925 Support check amazon linux version (#46) 43533bdd97 Change the exit value checking for test formats (#45) 3c88244c04 Update check-test-format to support a dir and a list of files (#44) 510d95f429 add extra check for error in auto-refresh detection function 3289d4031b Try open the log with latin-1 encoding when utf-8 is not working 9db785499f improved how the tools are waiting for system reboot 2a5c4414a3 fix shellcheck errors 5e7b63883d Fixes for osquery and tests pkgs (#43) 4c9145e2ac support reboot waiting for auto-refresh 45768f5188 show changes in unknown status after refresh 8013c30c2a Remove support for ubuntu 22.10 b32b80bf54 Fix remote.rait-for test in bionic 5675c625e9 Enable fedora 38 55f4471957 Support for new oss f2e88b357c New tool used to query spread json reports cacd35ede0 utils/spread-shellcheck: explain disabled warnings (#42) c82afb2dee Support --no-install-recommends parameter when installing dependencies with tests.pkgs b84eea92e2 spread-shellcheck: fix quotes in environment variables (#41) ab1e51c29f New comparison in os-query for core systems (#40) e5ae22a5d4 systemd units can be overwritten 63540b845a Fix error messages in remote pull and push 75e8a426a5 make sure the unit is removed in tests.systemd test 9089ff5c02 Update tests to use the new tests.systemd stop-unit 44ecd5e56a Move tests.systemd stop-units to stop-unit 01a2a83b4b Update tests.systemd to have stop units as systemd.sh 162e93bd35 update tests.systemd CLI options to be the same than retry command 14aa43a405 new feature to re-run failed spread tests (#39) 604cb782db Fix shellcheck in systemd tool bfc71082c8 Update the tests.systemd to allow parameters waiting for service status 8a2d0a99df Adding quiet tool and removing set +-x from tests.pkgs d90935d2a4 A comment explaining about the default values for wait-for 3232c5dba7 Add support for ubuntu 23.04 a7164fba07 remove fedora 35 support, add fedora 37 support 89b9eb5301 Update systems supported 92bb6a0664 Include snap-sufix in the snaps.name tool git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: f640ac72e316a598138a6b437d41441c7975d916 * Squashed 'tests/lib/external/snapd-testing-tools/' changes from f640ac72e3..b8d20c1d5b b8d20c1d5b fix snaps.name test with correct siffix spelling git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: b8d20c1d5b874c2f29da2f281b425124fea1f527 * Add more tests with details * adding one more test * adding missing tests * adding more test details * Update tests/lib/external/snapd-testing-tools/tests/remote.retry/task.yaml Co-authored-by: Andrew Phelps <136256549+andrewphelpsj@users.noreply.github.com> * Update tests/lib/tools/suite/tests.invariant/task.yaml Co-authored-by: Andrew Phelps <136256549+andrewphelpsj@users.noreply.github.com> * Update task.yaml * Update task.yaml * Update task.yaml --------- Co-authored-by: Andrew Phelps <136256549+andrewphelpsj@users.noreply.github.com> |
||
Zygmunt Bazyli Krynicki
|
62bdca3b06 |
tests/main: document more tests, tweak documentation of another (#13916)
* tests: fix typo: suffix Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@canonical.com> * tests/main: document snap-remove-not-mounted Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@canonical.com> * tests/main: reformat documentation of snap-routine-file-access Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@canonical.com> * tests/main: document snap-routine-portal-info Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@canonical.com> * tests/main: document snap-run-useradata-current Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@canonical.com> * tests/main: document snap-service Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@canonical.com> * tests/main: document snap-service-install-mode Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@canonical.com> * tests/main: document snap-services Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@canonical.com> --------- Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@canonical.com> |
||
|
Sergio Cazzolato
|
f2c7b3f9ed |
tests: import tests with details from snapd-testing-tools (#13846)
* Squashed 'tests/lib/external/snapd-testing-tools/' changes from 1c8efb77e1..94ac5ffe58 94ac5ffe58 Add details on tests 501578c719 add more checks in os.query to check is-core_xx e8929207ff fix os-query for ubuntu comparing with core 226114641f os.query won't check SPREAD_SYSTEM anymore to compare core systems b89ec98b23 use local variables in os.query tool dacfd81de9 fix is_core functions 1db5214d5f Improve the remote docs (#36) 2e4a3153a2 1 more comment 3a0fc57e1e add explanation about why we check for ( Do | Doing ) 4cf8e635bf fix os.query test after merge b89b4f8647 fix artifacts name d30cee6da0 Merge remote-tracking branch 'upstream/main' 5ef5dcbe8f Tests use artifacts in spread tests (#51) 555c43d2ab Support auto-refresh with Do instead of Doing 96c2b0c19c remove tests support for ubuntu 23.04 (EoL) 74082c0c34 Tests improve remote wait (#49) 5121bfb659 remove support for opensuse leap 15.4 (#48) 30df700d08 Add new systems support (#47) 1f08938925 Support check amazon linux version (#46) 43533bdd97 Change the exit value checking for test formats (#45) 3c88244c04 Update check-test-format to support a dir and a list of files (#44) 510d95f429 add extra check for error in auto-refresh detection function 3289d4031b Try open the log with latin-1 encoding when utf-8 is not working 9db785499f improved how the tools are waiting for system reboot 2a5c4414a3 fix shellcheck errors 5e7b63883d Fixes for osquery and tests pkgs (#43) 4c9145e2ac support reboot waiting for auto-refresh 45768f5188 show changes in unknown status after refresh 8013c30c2a Remove support for ubuntu 22.10 b32b80bf54 Fix remote.rait-for test in bionic 5675c625e9 Enable fedora 38 55f4471957 Support for new oss f2e88b357c New tool used to query spread json reports cacd35ede0 utils/spread-shellcheck: explain disabled warnings (#42) c82afb2dee Support --no-install-recommends parameter when installing dependencies with tests.pkgs b84eea92e2 spread-shellcheck: fix quotes in environment variables (#41) ab1e51c29f New comparison in os-query for core systems (#40) e5ae22a5d4 systemd units can be overwritten 63540b845a Fix error messages in remote pull and push 75e8a426a5 make sure the unit is removed in tests.systemd test 9089ff5c02 Update tests to use the new tests.systemd stop-unit 44ecd5e56a Move tests.systemd stop-units to stop-unit 01a2a83b4b Update tests.systemd to have stop units as systemd.sh 162e93bd35 update tests.systemd CLI options to be the same than retry command 14aa43a405 new feature to re-run failed spread tests (#39) 604cb782db Fix shellcheck in systemd tool bfc71082c8 Update the tests.systemd to allow parameters waiting for service status 8a2d0a99df Adding quiet tool and removing set +-x from tests.pkgs d90935d2a4 A comment explaining about the default values for wait-for 3232c5dba7 Add support for ubuntu 23.04 a7164fba07 remove fedora 35 support, add fedora 37 support 89b9eb5301 Update systems supported 92bb6a0664 Include snap-sufix in the snaps.name tool git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 94ac5ffe58b7e52f19f142453a78bd897bace122 * Update tests/lib/external/snapd-testing-tools/tests/log-analyzer/task.yaml Co-authored-by: Miguel Pires <miguelpires94@gmail.com> * Update tests/lib/external/snapd-testing-tools/tests/os.query/task.yaml Co-authored-by: Miguel Pires <miguelpires94@gmail.com> * Update tests/lib/external/snapd-testing-tools/tests/not/task.yaml Co-authored-by: Miguel Pires <miguelpires94@gmail.com> * Update tests/lib/external/snapd-testing-tools/tests/os.paths/task.yaml Co-authored-by: Miguel Pires <miguelpires94@gmail.com> * Update tests/lib/external/snapd-testing-tools/tests/remote.setup/task.yaml Co-authored-by: Miguel Pires <miguelpires94@gmail.com> * Update tests/lib/external/snapd-testing-tools/tests/tests.pkgs/task.yaml Co-authored-by: Miguel Pires <miguelpires94@gmail.com> * Update tests/lib/external/snapd-testing-tools/tests/spread-manager/task.yaml Co-authored-by: Miguel Pires <miguelpires94@gmail.com> * Update tests/lib/external/snapd-testing-tools/tests/snaps.name/task.yaml Co-authored-by: Miguel Pires <miguelpires94@gmail.com> * Update tests/lib/external/snapd-testing-tools/tests/tests.systemd/task.yaml Co-authored-by: Miguel Pires <miguelpires94@gmail.com> * Update tests/lib/external/snapd-testing-tools/tests/spread-shellcheck/task.yaml Co-authored-by: Miguel Pires <miguelpires94@gmail.com> * Update tests/lib/external/snapd-testing-tools/tests/retry/task.yaml Co-authored-by: Miguel Pires <miguelpires94@gmail.com> * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 94ac5ffe58..fc10196efd fc10196efd Add suggestions to details git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: fc10196efd33bd52c94323781de647ecf257f1d0 --------- Co-authored-by: Miguel Pires <miguelpires94@gmail.com> |
||
|
Sergio Cazzolato
|
031dc4d8d1 |
tests: enable nested uc24 (#13820)
* enable nested tests for uc24 * fix issue related to cloud init * some test fixes * Add missing details for tests * Adding missing details for nested tests * addin support for ubuntu-24.04 in upload-snapd-to-gce * updated the password for external users in spread.yaml |
||
|
Sergio Cazzolato
|
00be928761 |
tests: move ubuntu core os.query logic to prepare.sh (#13796)
* tests: move ubuntu core os.query logic to prepare.sh As in snapd to prepare ubuntu core first it is booted a classic image. The logic needed to manage that fact has been moved from os.query to prepare.sh This change is needed because os.query is a generic tool that is used in other projects and shouln't have logic specific to snapd project. * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 1c8efb77e1..226114641f 226114641f os.query won't check SPREAD_SYSTEM anymore to compare core systems b89ec98b23 use local variables in os.query tool dacfd81de9 fix is_core functions 1db5214d5f Improve the remote docs (#36) 2e4a3153a2 1 more comment 3a0fc57e1e add explanation about why we check for ( Do | Doing ) 4cf8e635bf fix os.query test after merge b89b4f8647 fix artifacts name d30cee6da0 Merge remote-tracking branch 'upstream/main' 5ef5dcbe8f Tests use artifacts in spread tests (#51) 555c43d2ab Support auto-refresh with Do instead of Doing 96c2b0c19c remove tests support for ubuntu 23.04 (EoL) 74082c0c34 Tests improve remote wait (#49) 5121bfb659 remove support for opensuse leap 15.4 (#48) 30df700d08 Add new systems support (#47) 1f08938925 Support check amazon linux version (#46) 43533bdd97 Change the exit value checking for test formats (#45) 3c88244c04 Update check-test-format to support a dir and a list of files (#44) 510d95f429 add extra check for error in auto-refresh detection function 3289d4031b Try open the log with latin-1 encoding when utf-8 is not working 9db785499f improved how the tools are waiting for system reboot 2a5c4414a3 fix shellcheck errors 5e7b63883d Fixes for osquery and tests pkgs (#43) 4c9145e2ac support reboot waiting for auto-refresh 45768f5188 show changes in unknown status after refresh 8013c30c2a Remove support for ubuntu 22.10 b32b80bf54 Fix remote.rait-for test in bionic 5675c625e9 Enable fedora 38 55f4471957 Support for new oss f2e88b357c New tool used to query spread json reports cacd35ede0 utils/spread-shellcheck: explain disabled warnings (#42) c82afb2dee Support --no-install-recommends parameter when installing dependencies with tests.pkgs b84eea92e2 spread-shellcheck: fix quotes in environment variables (#41) ab1e51c29f New comparison in os-query for core systems (#40) e5ae22a5d4 systemd units can be overwritten 63540b845a Fix error messages in remote pull and push 75e8a426a5 make sure the unit is removed in tests.systemd test 9089ff5c02 Update tests to use the new tests.systemd stop-unit 44ecd5e56a Move tests.systemd stop-units to stop-unit 01a2a83b4b Update tests.systemd to have stop units as systemd.sh 162e93bd35 update tests.systemd CLI options to be the same than retry command 14aa43a405 new feature to re-run failed spread tests (#39) 604cb782db Fix shellcheck in systemd tool bfc71082c8 Update the tests.systemd to allow parameters waiting for service status 8a2d0a99df Adding quiet tool and removing set +-x from tests.pkgs d90935d2a4 A comment explaining about the default values for wait-for 3232c5dba7 Add support for ubuntu 23.04 a7164fba07 remove fedora 35 support, add fedora 37 support 89b9eb5301 Update systems supported 92bb6a0664 Include snap-sufix in the snaps.name tool git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 226114641f71b2264ff2cfc857855a6b089cded7 * fix shellcheck * add details to listing test * Update tests/lib/prepare.sh Co-authored-by: Maciej Borzecki <maciek.borzecki@gmail.com> * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 226114641f..e8929207ff e8929207ff fix os-query for ubuntu comparing with core git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: e8929207ffe6f48915e48199726b5d163e73baba * Squashed 'tests/lib/external/snapd-testing-tools/' changes from e8929207ff..501578c719 501578c719 add more checks in os.query to check is-core_xx git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 501578c719d6677241dda845c3082182a8c2dc76 * update os.query --------- Co-authored-by: Maciej Borzecki <maciek.borzecki@gmail.com> |
||
|
Zygmunt Krynicki
|
6bff8db24c |
tests: teach spread-shellcheck about spread variables
Signed-off-by: Zygmunt Krynicki <zygmunt.krynicki@canonical.com> |
||
|
Sergio Cazzolato
|
2b482743b6 |
tests: initial changes to run core suite in uc24 (#13712)
* tests: initial changes to run core suite in uc24 Changes needed to run core test suite in uc24 * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 1c8efb77e1..1db5214d5f 1db5214d5f Improve the remote docs (#36) 2e4a3153a2 1 more comment 3a0fc57e1e add explanation about why we check for ( Do | Doing ) 4cf8e635bf fix os.query test after merge b89b4f8647 fix artifacts name d30cee6da0 Merge remote-tracking branch 'upstream/main' 5ef5dcbe8f Tests use artifacts in spread tests (#51) 555c43d2ab Support auto-refresh with Do instead of Doing 96c2b0c19c remove tests support for ubuntu 23.04 (EoL) 74082c0c34 Tests improve remote wait (#49) 5121bfb659 remove support for opensuse leap 15.4 (#48) 30df700d08 Add new systems support (#47) 1f08938925 Support check amazon linux version (#46) 43533bdd97 Change the exit value checking for test formats (#45) 3c88244c04 Update check-test-format to support a dir and a list of files (#44) 510d95f429 add extra check for error in auto-refresh detection function 3289d4031b Try open the log with latin-1 encoding when utf-8 is not working 9db785499f improved how the tools are waiting for system reboot 2a5c4414a3 fix shellcheck errors 5e7b63883d Fixes for osquery and tests pkgs (#43) 4c9145e2ac support reboot waiting for auto-refresh 45768f5188 show changes in unknown status after refresh 8013c30c2a Remove support for ubuntu 22.10 b32b80bf54 Fix remote.rait-for test in bionic 5675c625e9 Enable fedora 38 55f4471957 Support for new oss f2e88b357c New tool used to query spread json reports cacd35ede0 utils/spread-shellcheck: explain disabled warnings (#42) c82afb2dee Support --no-install-recommends parameter when installing dependencies with tests.pkgs b84eea92e2 spread-shellcheck: fix quotes in environment variables (#41) ab1e51c29f New comparison in os-query for core systems (#40) e5ae22a5d4 systemd units can be overwritten 63540b845a Fix error messages in remote pull and push 75e8a426a5 make sure the unit is removed in tests.systemd test 9089ff5c02 Update tests to use the new tests.systemd stop-unit 44ecd5e56a Move tests.systemd stop-units to stop-unit 01a2a83b4b Update tests.systemd to have stop units as systemd.sh 162e93bd35 update tests.systemd CLI options to be the same than retry command 14aa43a405 new feature to re-run failed spread tests (#39) 604cb782db Fix shellcheck in systemd tool bfc71082c8 Update the tests.systemd to allow parameters waiting for service status 8a2d0a99df Adding quiet tool and removing set +-x from tests.pkgs d90935d2a4 A comment explaining about the default values for wait-for 3232c5dba7 Add support for ubuntu 23.04 a7164fba07 remove fedora 35 support, add fedora 37 support 89b9eb5301 Update systems supported 92bb6a0664 Include snap-sufix in the snaps.name tool git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 1db5214d5fe91d90b4ffcd4768db8080fcc245ab * fix core version under test * adding missing model * add missing function in nested.sh * fix keys used for uc24 * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 1db5214d5f..dacfd81de9 dacfd81de9 fix is_core functions git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: dacfd81de95e05a9e56d84be45e0611275b083f4 * use pc-kernel from beta channel * removing file created for workflow tests * remove more dirs created during automatic merge * restore perimssions for files in test snap-repair * restore tools permissions merged incorrectly * fix wording in test * Squashed 'tests/lib/external/snapd-testing-tools/' changes from dacfd81de9..b89ec98b23 b89ec98b23 use local variables in os.query tool git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: b89ec98b239dc9ef729b6af68ce1b5028b4eee23 * fix remove test details |
||
|
Sergio Cazzolato
|
8996c3602b |
tests: allow running edge/beta validation in google instances (#13639)
* new full-run test * update tests to support pre-built images * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 1c8efb77e1..74082c0c34 74082c0c34 Tests improve remote wait (#49) 5121bfb659 remove support for opensuse leap 15.4 (#48) 30df700d08 Add new systems support (#47) 1f08938925 Support check amazon linux version (#46) 43533bdd97 Change the exit value checking for test formats (#45) 3c88244c04 Update check-test-format to support a dir and a list of files (#44) 510d95f429 add extra check for error in auto-refresh detection function 3289d4031b Try open the log with latin-1 encoding when utf-8 is not working 9db785499f improved how the tools are waiting for system reboot 2a5c4414a3 fix shellcheck errors 5e7b63883d Fixes for osquery and tests pkgs (#43) 4c9145e2ac support reboot waiting for auto-refresh 45768f5188 show changes in unknown status after refresh 8013c30c2a Remove support for ubuntu 22.10 b32b80bf54 Fix remote.rait-for test in bionic 5675c625e9 Enable fedora 38 55f4471957 Support for new oss f2e88b357c New tool used to query spread json reports cacd35ede0 utils/spread-shellcheck: explain disabled warnings (#42) c82afb2dee Support --no-install-recommends parameter when installing dependencies with tests.pkgs b84eea92e2 spread-shellcheck: fix quotes in environment variables (#41) ab1e51c29f New comparison in os-query for core systems (#40) e5ae22a5d4 systemd units can be overwritten 63540b845a Fix error messages in remote pull and push 75e8a426a5 make sure the unit is removed in tests.systemd test 9089ff5c02 Update tests to use the new tests.systemd stop-unit 44ecd5e56a Move tests.systemd stop-units to stop-unit 01a2a83b4b Update tests.systemd to have stop units as systemd.sh 162e93bd35 update tests.systemd CLI options to be the same than retry command 14aa43a405 new feature to re-run failed spread tests (#39) 604cb782db Fix shellcheck in systemd tool bfc71082c8 Update the tests.systemd to allow parameters waiting for service status 8a2d0a99df Adding quiet tool and removing set +-x from tests.pkgs d90935d2a4 A comment explaining about the default values for wait-for 3232c5dba7 Add support for ubuntu 23.04 a7164fba07 remove fedora 35 support, add fedora 37 support 89b9eb5301 Update systems supported 92bb6a0664 Include snap-sufix in the snaps.name tool git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 74082c0c345a7707ca360d2177a23ee958c880bd * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 74082c0c34..5ef5dcbe8f 5ef5dcbe8f Tests use artifacts in spread tests (#51) git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 5ef5dcbe8f376e3958019fffcd54fd6add8117a4 * update args order in new test * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 5ef5dcbe8f..b89b4f8647 b89b4f8647 fix artifacts name d30cee6da0 Merge remote-tracking branch 'upstream/main' 555c43d2ab Support auto-refresh with Do instead of Doing 96c2b0c19c remove tests support for ubuntu 23.04 (EoL) git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: b89b4f86471b76eae9d5ac1b1f55728598da544e * improbe checks in nested.sh * Squashed 'tests/lib/external/snapd-testing-tools/' changes from b89b4f8647..4cf8e635bf 4cf8e635bf fix os.query test after merge git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 4cf8e635bf65f974dbcc5b303f890ac9078ed78a * removing duplicated debian-11 * remove another merge error * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 4cf8e635bf..3a0fc57e1e 3a0fc57e1e add explanation about why we check for ( Do | Doing ) git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 3a0fc57e1eaf13b189a83982835cf289b3dfad3c * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 3a0fc57e1e..2e4a3153a2 2e4a3153a2 1 more comment git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 2e4a3153a27529092156fbe723cdfef221467bd4 * increase limit waiting for log changes because check to ntp server breaks * increase time to wait for log changes * wait more time waiting for changes in the log It gets stuck more than 60 seconds waiting for ntp sync |
||
|
Sergio Cazzolato
|
ab5b801395 |
tests: remove ubuntu lunar support (#13593)
* tests: Remove tests support for ubuntu 23.04 (EoL) * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 1c8efb77e1..5121bfb659 5121bfb659 remove support for opensuse leap 15.4 (#48) 30df700d08 Add new systems support (#47) 1f08938925 Support check amazon linux version (#46) 43533bdd97 Change the exit value checking for test formats (#45) 3c88244c04 Update check-test-format to support a dir and a list of files (#44) 510d95f429 add extra check for error in auto-refresh detection function 3289d4031b Try open the log with latin-1 encoding when utf-8 is not working 9db785499f improved how the tools are waiting for system reboot 2a5c4414a3 fix shellcheck errors 5e7b63883d Fixes for osquery and tests pkgs (#43) 4c9145e2ac support reboot waiting for auto-refresh 45768f5188 show changes in unknown status after refresh 8013c30c2a Remove support for ubuntu 22.10 b32b80bf54 Fix remote.rait-for test in bionic 5675c625e9 Enable fedora 38 55f4471957 Support for new oss f2e88b357c New tool used to query spread json reports cacd35ede0 utils/spread-shellcheck: explain disabled warnings (#42) c82afb2dee Support --no-install-recommends parameter when installing dependencies with tests.pkgs b84eea92e2 spread-shellcheck: fix quotes in environment variables (#41) ab1e51c29f New comparison in os-query for core systems (#40) e5ae22a5d4 systemd units can be overwritten 63540b845a Fix error messages in remote pull and push 75e8a426a5 make sure the unit is removed in tests.systemd test 9089ff5c02 Update tests to use the new tests.systemd stop-unit 44ecd5e56a Move tests.systemd stop-units to stop-unit 01a2a83b4b Update tests.systemd to have stop units as systemd.sh 162e93bd35 update tests.systemd CLI options to be the same than retry command 14aa43a405 new feature to re-run failed spread tests (#39) 604cb782db Fix shellcheck in systemd tool bfc71082c8 Update the tests.systemd to allow parameters waiting for service status 8a2d0a99df Adding quiet tool and removing set +-x from tests.pkgs d90935d2a4 A comment explaining about the default values for wait-for 3232c5dba7 Add support for ubuntu 23.04 a7164fba07 remove fedora 35 support, add fedora 37 support 89b9eb5301 Update systems supported 92bb6a0664 Include snap-sufix in the snaps.name tool git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 5121bfb659bb9602f7d5a8a2f354dd93662270dc * update message in desktop-portal-screenshot test * add details to updated tests |
||
|
Sergio Cazzolato
|
7a52689b5d |
tests: remove opensuse 15 4 (#13444)
* tests: remove support for opensuse 15.4 Opensuse leap 15.4 is EoL since december 2023 * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 1c8efb77e1..5121bfb659 5121bfb659 remove support for opensuse leap 15.4 (#48) 30df700d08 Add new systems support (#47) 1f08938925 Support check amazon linux version (#46) 43533bdd97 Change the exit value checking for test formats (#45) 3c88244c04 Update check-test-format to support a dir and a list of files (#44) 510d95f429 add extra check for error in auto-refresh detection function 3289d4031b Try open the log with latin-1 encoding when utf-8 is not working 9db785499f improved how the tools are waiting for system reboot 2a5c4414a3 fix shellcheck errors 5e7b63883d Fixes for osquery and tests pkgs (#43) 4c9145e2ac support reboot waiting for auto-refresh 45768f5188 show changes in unknown status after refresh 8013c30c2a Remove support for ubuntu 22.10 b32b80bf54 Fix remote.rait-for test in bionic 5675c625e9 Enable fedora 38 55f4471957 Support for new oss f2e88b357c New tool used to query spread json reports cacd35ede0 utils/spread-shellcheck: explain disabled warnings (#42) c82afb2dee Support --no-install-recommends parameter when installing dependencies with tests.pkgs b84eea92e2 spread-shellcheck: fix quotes in environment variables (#41) ab1e51c29f New comparison in os-query for core systems (#40) e5ae22a5d4 systemd units can be overwritten 63540b845a Fix error messages in remote pull and push 75e8a426a5 make sure the unit is removed in tests.systemd test 9089ff5c02 Update tests to use the new tests.systemd stop-unit 44ecd5e56a Move tests.systemd stop-units to stop-unit 01a2a83b4b Update tests.systemd to have stop units as systemd.sh 162e93bd35 update tests.systemd CLI options to be the same than retry command 14aa43a405 new feature to re-run failed spread tests (#39) 604cb782db Fix shellcheck in systemd tool bfc71082c8 Update the tests.systemd to allow parameters waiting for service status 8a2d0a99df Adding quiet tool and removing set +-x from tests.pkgs d90935d2a4 A comment explaining about the default values for wait-for 3232c5dba7 Add support for ubuntu 23.04 a7164fba07 remove fedora 35 support, add fedora 37 support 89b9eb5301 Update systems supported 92bb6a0664 Include snap-sufix in the snaps.name tool git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 5121bfb659bb9602f7d5a8a2f354dd93662270dc * fix opensuse duplication |
||
|
Sergio Cazzolato
|
12221c76eb |
tests: add support for fedora 39 and remove support for fedora 37 (#13427)
* tests: add support for fedora 39 and remove support for fedora 37 Fedora 37 eol: November 14th, 2023 * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 1c8efb77e1..30df700d08 30df700d08 Add new systems support (#47) 1f08938925 Support check amazon linux version (#46) 43533bdd97 Change the exit value checking for test formats (#45) 3c88244c04 Update check-test-format to support a dir and a list of files (#44) 510d95f429 add extra check for error in auto-refresh detection function 3289d4031b Try open the log with latin-1 encoding when utf-8 is not working 9db785499f improved how the tools are waiting for system reboot 2a5c4414a3 fix shellcheck errors 5e7b63883d Fixes for osquery and tests pkgs (#43) 4c9145e2ac support reboot waiting for auto-refresh 45768f5188 show changes in unknown status after refresh 8013c30c2a Remove support for ubuntu 22.10 b32b80bf54 Fix remote.rait-for test in bionic 5675c625e9 Enable fedora 38 55f4471957 Support for new oss f2e88b357c New tool used to query spread json reports cacd35ede0 utils/spread-shellcheck: explain disabled warnings (#42) c82afb2dee Support --no-install-recommends parameter when installing dependencies with tests.pkgs b84eea92e2 spread-shellcheck: fix quotes in environment variables (#41) ab1e51c29f New comparison in os-query for core systems (#40) e5ae22a5d4 systemd units can be overwritten 63540b845a Fix error messages in remote pull and push 75e8a426a5 make sure the unit is removed in tests.systemd test 9089ff5c02 Update tests to use the new tests.systemd stop-unit 44ecd5e56a Move tests.systemd stop-units to stop-unit 01a2a83b4b Update tests.systemd to have stop units as systemd.sh 162e93bd35 update tests.systemd CLI options to be the same than retry command 14aa43a405 new feature to re-run failed spread tests (#39) 604cb782db Fix shellcheck in systemd tool bfc71082c8 Update the tests.systemd to allow parameters waiting for service status 8a2d0a99df Adding quiet tool and removing set +-x from tests.pkgs d90935d2a4 A comment explaining about the default values for wait-for 3232c5dba7 Add support for ubuntu 23.04 a7164fba07 remove fedora 35 support, add fedora 37 support 89b9eb5301 Update systems supported 92bb6a0664 Include snap-sufix in the snaps.name tool git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 30df700d08184e1f11ecc8801fa0f8490086fd94 * add details on tests * revert fedora snapd.spec deletion * skip interfaces-{calendar,contacts}-service tests |
||
|
Sergio Cazzolato
|
3c12e05ab7 |
tests: add amazon linux 2023 (#13409)
* tests: add support for amazon-linux-2023 * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 1c8efb77e1..1f08938925 1f08938925 Support check amazon linux version (#46) 43533bdd97 Change the exit value checking for test formats (#45) 3c88244c04 Update check-test-format to support a dir and a list of files (#44) 510d95f429 add extra check for error in auto-refresh detection function 3289d4031b Try open the log with latin-1 encoding when utf-8 is not working 9db785499f improved how the tools are waiting for system reboot 2a5c4414a3 fix shellcheck errors 5e7b63883d Fixes for osquery and tests pkgs (#43) 4c9145e2ac support reboot waiting for auto-refresh 45768f5188 show changes in unknown status after refresh 8013c30c2a Remove support for ubuntu 22.10 b32b80bf54 Fix remote.rait-for test in bionic 5675c625e9 Enable fedora 38 55f4471957 Support for new oss f2e88b357c New tool used to query spread json reports cacd35ede0 utils/spread-shellcheck: explain disabled warnings (#42) c82afb2dee Support --no-install-recommends parameter when installing dependencies with tests.pkgs b84eea92e2 spread-shellcheck: fix quotes in environment variables (#41) ab1e51c29f New comparison in os-query for core systems (#40) e5ae22a5d4 systemd units can be overwritten 63540b845a Fix error messages in remote pull and push 75e8a426a5 make sure the unit is removed in tests.systemd test 9089ff5c02 Update tests to use the new tests.systemd stop-unit 44ecd5e56a Move tests.systemd stop-units to stop-unit 01a2a83b4b Update tests.systemd to have stop units as systemd.sh 162e93bd35 update tests.systemd CLI options to be the same than retry command 14aa43a405 new feature to re-run failed spread tests (#39) 604cb782db Fix shellcheck in systemd tool bfc71082c8 Update the tests.systemd to allow parameters waiting for service status 8a2d0a99df Adding quiet tool and removing set +-x from tests.pkgs d90935d2a4 A comment explaining about the default values for wait-for 3232c5dba7 Add support for ubuntu 23.04 a7164fba07 remove fedora 35 support, add fedora 37 support 89b9eb5301 Update systems supported 92bb6a0664 Include snap-sufix in the snaps.name tool git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 1f08938925bac7f52451487ed66e21b02e7e0fe2 * updating support for amazon linux 2023 packaging * add a case to manage amzn2023 as bundled * update tests and dependencies for al2023 * Add details for updated tests * more tests fixes for al2023 * Amazon Linux 2023 disables /dev/mem, and /dev/port completely * Fix docment-portal-activation test * skip hook-permissions in al2023 See upower is not available in al223: https://docs.aws.amazon.com/linux/al2023/release-notes/relnotes-2022.0.20220824.html |
||
|
Sergio Cazzolato
|
24334ccf2e |
tests: enforce tests details (#13357)
* Update run-checks to pass changed tests to check-test-format utility * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 1c8efb77e1..3c88244c04 3c88244c04 Update check-test-format to support a dir and a list of files (#44) 510d95f429 add extra check for error in auto-refresh detection function 3289d4031b Try open the log with latin-1 encoding when utf-8 is not working 9db785499f improved how the tools are waiting for system reboot 2a5c4414a3 fix shellcheck errors 5e7b63883d Fixes for osquery and tests pkgs (#43) 4c9145e2ac support reboot waiting for auto-refresh 45768f5188 show changes in unknown status after refresh 8013c30c2a Remove support for ubuntu 22.10 b32b80bf54 Fix remote.rait-for test in bionic 5675c625e9 Enable fedora 38 55f4471957 Support for new oss f2e88b357c New tool used to query spread json reports cacd35ede0 utils/spread-shellcheck: explain disabled warnings (#42) c82afb2dee Support --no-install-recommends parameter when installing dependencies with tests.pkgs b84eea92e2 spread-shellcheck: fix quotes in environment variables (#41) ab1e51c29f New comparison in os-query for core systems (#40) e5ae22a5d4 systemd units can be overwritten 63540b845a Fix error messages in remote pull and push 75e8a426a5 make sure the unit is removed in tests.systemd test 9089ff5c02 Update tests to use the new tests.systemd stop-unit 44ecd5e56a Move tests.systemd stop-units to stop-unit 01a2a83b4b Update tests.systemd to have stop units as systemd.sh 162e93bd35 update tests.systemd CLI options to be the same than retry command 14aa43a405 new feature to re-run failed spread tests (#39) 604cb782db Fix shellcheck in systemd tool bfc71082c8 Update the tests.systemd to allow parameters waiting for service status 8a2d0a99df Adding quiet tool and removing set +-x from tests.pkgs d90935d2a4 A comment explaining about the default values for wait-for 3232c5dba7 Add support for ubuntu 23.04 a7164fba07 remove fedora 35 support, add fedora 37 support 89b9eb5301 Update systems supported 92bb6a0664 Include snap-sufix in the snaps.name tool git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 3c88244c040ab65c5bb9645c3b11c4111440de9d * Modify a test to make sure it is required to add a detail * filter tests from external sources * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 3c88244c04..43533bdd97 43533bdd97 Change the exit value checking for test formats (#45) git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 43533bdd976fda6ede0e538467c2aa42954dc96d * fix shellcheck error * give the absolute path to the check-tests-format tool * Remove pwd command * avoid empty spaces in string * Add a detail to the task This should make the check to pass |
||
|
Sergio Cazzolato
|
6d1a3ceabc |
tests: update snapd-testing-tools and fix nested workflow (#13287)
* Squashed 'tests/lib/external/snapd-testing-tools/' changes from 1c8efb77e1..510d95f429 510d95f429 add extra check for error in auto-refresh detection function 3289d4031b Try open the log with latin-1 encoding when utf-8 is not working 9db785499f improved how the tools are waiting for system reboot 2a5c4414a3 fix shellcheck errors 5e7b63883d Fixes for osquery and tests pkgs (#43) 4c9145e2ac support reboot waiting for auto-refresh 45768f5188 show changes in unknown status after refresh 8013c30c2a Remove support for ubuntu 22.10 b32b80bf54 Fix remote.rait-for test in bionic 5675c625e9 Enable fedora 38 55f4471957 Support for new oss f2e88b357c New tool used to query spread json reports cacd35ede0 utils/spread-shellcheck: explain disabled warnings (#42) c82afb2dee Support --no-install-recommends parameter when installing dependencies with tests.pkgs b84eea92e2 spread-shellcheck: fix quotes in environment variables (#41) ab1e51c29f New comparison in os-query for core systems (#40) e5ae22a5d4 systemd units can be overwritten 63540b845a Fix error messages in remote pull and push 75e8a426a5 make sure the unit is removed in tests.systemd test 9089ff5c02 Update tests to use the new tests.systemd stop-unit 44ecd5e56a Move tests.systemd stop-units to stop-unit 01a2a83b4b Update tests.systemd to have stop units as systemd.sh 162e93bd35 update tests.systemd CLI options to be the same than retry command 14aa43a405 new feature to re-run failed spread tests (#39) 604cb782db Fix shellcheck in systemd tool bfc71082c8 Update the tests.systemd to allow parameters waiting for service status 8a2d0a99df Adding quiet tool and removing set +-x from tests.pkgs d90935d2a4 A comment explaining about the default values for wait-for 3232c5dba7 Add support for ubuntu 23.04 a7164fba07 remove fedora 35 support, add fedora 37 support 89b9eb5301 Update systems supported 92bb6a0664 Include snap-sufix in the snaps.name tool git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 510d95f4292c9edbb292bcb4560c4fee98a3d01c |
||
|
Sergio Cazzolato
|
031a0935db |
tests: first part of the improvements done for pkg management (#12869)
* First part of the improvements done for pkg management The idea of this change is to use the tests.pkg tools instead of the pkgdb.sh helper when possible * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 1c8efb77e1..c82afb2dee c82afb2dee Support --no-install-recommends parameter when installing dependencies with tests.pkgs b84eea92e2 spread-shellcheck: fix quotes in environment variables (#41) ab1e51c29f New comparison in os-query for core systems (#40) e5ae22a5d4 systemd units can be overwritten 63540b845a Fix error messages in remote pull and push 75e8a426a5 make sure the unit is removed in tests.systemd test 9089ff5c02 Update tests to use the new tests.systemd stop-unit 44ecd5e56a Move tests.systemd stop-units to stop-unit 01a2a83b4b Update tests.systemd to have stop units as systemd.sh 162e93bd35 update tests.systemd CLI options to be the same than retry command 14aa43a405 new feature to re-run failed spread tests (#39) 604cb782db Fix shellcheck in systemd tool bfc71082c8 Update the tests.systemd to allow parameters waiting for service status 8a2d0a99df Adding quiet tool and removing set +-x from tests.pkgs d90935d2a4 A comment explaining about the default values for wait-for 3232c5dba7 Add support for ubuntu 23.04 a7164fba07 remove fedora 35 support, add fedora 37 support 89b9eb5301 Update systems supported 92bb6a0664 Include snap-sufix in the snaps.name tool git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: c82afb2dee93a6f2ee047608f0e27d3c4af10a88 * defer tests.pkgs remove inotify-tools * Squashed 'tests/lib/external/snapd-testing-tools/' changes from c82afb2dee..5e7b63883d 5e7b63883d Fixes for osquery and tests pkgs (#43) 4c9145e2ac support reboot waiting for auto-refresh 45768f5188 show changes in unknown status after refresh 8013c30c2a Remove support for ubuntu 22.10 b32b80bf54 Fix remote.rait-for test in bionic 5675c625e9 Enable fedora 38 55f4471957 Support for new oss f2e88b357c New tool used to query spread json reports cacd35ede0 utils/spread-shellcheck: explain disabled warnings (#42) git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 5e7b63883df49cdc72e2fc1fe0a23dd79224ab27 * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 5e7b63883d..2a5c4414a3 2a5c4414a3 fix shellcheck errors git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 2a5c4414a3db1ec8f8e37ee78d7d3c5b5b7a082b |
||
|
Sergio Cazzolato
|
f4ec590bfa |
tests: remove kinetic (#13016)
* Remove testing support for ubuntu 22.10 This is done because ubuntu 22.10 is EOL * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 1c8efb77e1..8013c30c2a 8013c30c2a Remove support for ubuntu 22.10 b32b80bf54 Fix remote.rait-for test in bionic 5675c625e9 Enable fedora 38 55f4471957 Support for new oss f2e88b357c New tool used to query spread json reports cacd35ede0 utils/spread-shellcheck: explain disabled warnings (#42) c82afb2dee Support --no-install-recommends parameter when installing dependencies with tests.pkgs b84eea92e2 spread-shellcheck: fix quotes in environment variables (#41) ab1e51c29f New comparison in os-query for core systems (#40) e5ae22a5d4 systemd units can be overwritten 63540b845a Fix error messages in remote pull and push 75e8a426a5 make sure the unit is removed in tests.systemd test 9089ff5c02 Update tests to use the new tests.systemd stop-unit 44ecd5e56a Move tests.systemd stop-units to stop-unit 01a2a83b4b Update tests.systemd to have stop units as systemd.sh 162e93bd35 update tests.systemd CLI options to be the same than retry command 14aa43a405 new feature to re-run failed spread tests (#39) 604cb782db Fix shellcheck in systemd tool bfc71082c8 Update the tests.systemd to allow parameters waiting for service status 8a2d0a99df Adding quiet tool and removing set +-x from tests.pkgs d90935d2a4 A comment explaining about the default values for wait-for 3232c5dba7 Add support for ubuntu 23.04 a7164fba07 remove fedora 35 support, add fedora 37 support 89b9eb5301 Update systems supported 92bb6a0664 Include snap-sufix in the snaps.name tool git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 8013c30c2a22185afd4c4464176e3fec1d7f2ab0 |
||
|
Sergio Cazzolato
|
63030757f9 |
tests: add support for debian 12 and remove support for debian 10 (#12907)
* Adding support for debian 12 and remove support for debian 10 * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 1c8efb77e1..55f4471957 55f4471957 Support for new oss f2e88b357c New tool used to query spread json reports cacd35ede0 utils/spread-shellcheck: explain disabled warnings (#42) c82afb2dee Support --no-install-recommends parameter when installing dependencies with tests.pkgs b84eea92e2 spread-shellcheck: fix quotes in environment variables (#41) ab1e51c29f New comparison in os-query for core systems (#40) e5ae22a5d4 systemd units can be overwritten 63540b845a Fix error messages in remote pull and push 75e8a426a5 make sure the unit is removed in tests.systemd test 9089ff5c02 Update tests to use the new tests.systemd stop-unit 44ecd5e56a Move tests.systemd stop-units to stop-unit 01a2a83b4b Update tests.systemd to have stop units as systemd.sh 162e93bd35 update tests.systemd CLI options to be the same than retry command 14aa43a405 new feature to re-run failed spread tests (#39) 604cb782db Fix shellcheck in systemd tool bfc71082c8 Update the tests.systemd to allow parameters waiting for service status 8a2d0a99df Adding quiet tool and removing set +-x from tests.pkgs d90935d2a4 A comment explaining about the default values for wait-for 3232c5dba7 Add support for ubuntu 23.04 a7164fba07 remove fedora 35 support, add fedora 37 support 89b9eb5301 Update systems supported 92bb6a0664 Include snap-sufix in the snaps.name tool git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 55f44719573eb8a87824670132db00777307f0e6 * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 55f4471957..5675c625e9 5675c625e9 Enable fedora 38 git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 5675c625e9a30d2a6a5ad46f0a8e9aa1a8fabfde * Add missing dependencies for debian 12 * skip tests for all debian * Fix missing tests for debian 12 * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 5675c625e9..b32b80bf54 b32b80bf54 Fix remote.rait-for test in bionic git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: b32b80bf5421af49b9bb8de492e4a12a0cd2e3fb |
||
Valentin David
|
47a9204792 | spread-shellcheck: fix quotes in environment variables | ||
|
Sergio Cazzolato
|
cfccc9a891 |
tests: replace the systemd.sh helper by the tests.systemd tool in tests/lib (#12663)
* Repleace the systemd.sh helper by the tests.systemd tool in tests/lib This is the first part of the migration to start using the tests.systemd tool instead of the systemd.sh helper * Fix shellcheck issues * move function to get active snapd units to state.sh It is the only place where the function is used * Update missing functions in nested.sh * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 1c8efb77e1..14aa43a405 14aa43a405 new feature to re-run failed spread tests (#39) 604cb782db Fix shellcheck in systemd tool bfc71082c8 Update the tests.systemd to allow parameters waiting for service status 8a2d0a99df Adding quiet tool and removing set +-x from tests.pkgs d90935d2a4 A comment explaining about the default values for wait-for 3232c5dba7 Add support for ubuntu 23.04 a7164fba07 remove fedora 35 support, add fedora 37 support 89b9eb5301 Update systems supported 92bb6a0664 Include snap-sufix in the snaps.name tool git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 14aa43a405f344b056db4fec7aee78709c41959a * use -n for tests.systemd wait-for-service * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 14aa43a405..162e93bd35 162e93bd35 update tests.systemd CLI options to be the same than retry command git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 162e93bd356f202b68408d0391b34e93a4f98755 * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 162e93bd35..01a2a83b4b 01a2a83b4b Update tests.systemd to have stop units as systemd.sh git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 01a2a83b4b58262e13ca2578ac286a41b780fa7d * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 01a2a83b4b..9089ff5c02 9089ff5c02 Update tests to use the new tests.systemd stop-unit 44ecd5e56a Move tests.systemd stop-units to stop-unit git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 9089ff5c02a1cf074a05fb7c58af93274f63a446 * Use the new tests.systemd stop-unit command * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 9089ff5c02..75e8a426a5 75e8a426a5 make sure the unit is removed in tests.systemd test git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 75e8a426a59fb02ee74d5bb7c60c19403c9146a0 * Fix error in test muinstaller-real the vm needs to be removed before creating a new one * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 75e8a426a5..63540b845a 63540b845a Fix error messages in remote pull and push git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 63540b845a542ee0a71257e0a726a618201ebb5d * update how stop is used in muinstaller-real nested test * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 63540b845a..e5ae22a5d4 e5ae22a5d4 systemd units can be overwritten git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: e5ae22a5d42b55d6b33c3f692968e72c62a619dc |
||
|
Sergio Cazzolato
|
e28beaa907 |
tests: use quiet tool from snapd-testing-tools (#12658)
* Remove quiet helper * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 1c8efb77e1..8a2d0a99df 8a2d0a99df Adding quiet tool and removing set +-x from tests.pkgs d90935d2a4 A comment explaining about the default values for wait-for 3232c5dba7 Add support for ubuntu 23.04 a7164fba07 remove fedora 35 support, add fedora 37 support 89b9eb5301 Update systems supported 92bb6a0664 Include snap-sufix in the snaps.name tool git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 8a2d0a99df94f086f4f40b79471b35443c0aff5f * Adding missing binary * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 8a2d0a99df..bfc71082c8 bfc71082c8 Update the tests.systemd to allow parameters waiting for service status git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: bfc71082c85c10f8940ee4def18f576f1ed273ca * Squashed 'tests/lib/external/snapd-testing-tools/' changes from bfc71082c8..604cb782db 604cb782db Fix shellcheck in systemd tool git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 604cb782db444110108cd212f00aef0050e3a5a2 |
||
|
Sergio Cazzolato
|
6d34193eee |
tests: new store-state tool (#12575)
* New store-state tool This is the new store tool inclusing a new test. Also it is included a network-state tool Still missing some parts of the test and a new test for the network state tool. This can be added in a following pr including the migration from the network-state helper to the new tool in all the tests * Fix wording in comment * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 49f30b6a47..92bb6a0664 92bb6a0664 Include snap-sufix in the snaps.name tool 1c8efb77e1 Update default values for wait-for reboot git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 92bb6a066478a46018297e23a409ec01fb682b37 * update tools using lower case vars and scoped vars * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 92bb6a0664..89b9eb5301 89b9eb5301 Update systems supported git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 89b9eb5301b6b8021e42d71162a7d4860279ad0b * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 89b9eb5301..a7164fba07 a7164fba07 remove fedora 35 support, add fedora 37 support git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: a7164fba070cb36fce40714b9a5c84f35867495b * Squashed 'tests/lib/external/snapd-testing-tools/' changes from a7164fba07..3232c5dba7 3232c5dba7 Add support for ubuntu 23.04 git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: 3232c5dba768f226213bfaec56bced7c384f140f * new lines * Squashed 'tests/lib/external/snapd-testing-tools/' changes from 3232c5dba7..d90935d2a4 d90935d2a4 A comment explaining about the default values for wait-for git-subtree-dir: tests/lib/external/snapd-testing-tools git-subtree-split: d90935d2a4000bd17c7a8a2754adb66f8234bb9b * skip ubuntu trusty for store-state test because systemd-run is not supported * Fix systems for store-state test |
||
|
Sergio Cazzolato
|
1d2c2da950 | Merge commit '208d6260c69ec80b524adff7b5d0a4d94ecc8e66' into tests-update-nested-tests-again-p1 |