WIP: TestDriver: Update to v3 (#690)

**Action Required:**
We've moved to an authenticated system and you must now provide an
authentication key within our script.

1. Create an account or log into https://app.dashcam.io. 
2. Copy the API key from https://app.dashcam.io/team. You must be the
team "owner"
3. Add the API key as `DASHCAM_API_KEY` within GitHub actions by
following the guide
[here](https://docs.github.com/en/actions/security-guides/using-secrets-in-github-actions).

This PR moves to our v3 system which includes

- Faster and more stable tests. Notice we're using a `yml` file to guide
the test rather than open prompts. This means the AI will follow the
same steps every time.
- Smarter AI. Better text matching, and more commands. We optimized how
the AI matches text and images, making it way faster and more
fault-tolerant.
- Better summaries. The AI will summarize the full test execution as
well as errors
- Assertions. We can now explicitly ask the AI to verify things on
screen
- Embedded tests. We can nest scripts for reusable components.

---------

Co-authored-by: orliesaurus <orliesaurus@users.noreply.github.com>
This commit is contained in:
Ian Jennings
2024-07-02 14:38:05 -05:00
committed by GitHub
co-authored by orliesaurus
parent d54a61658f
commit 3d72e97831
3 changed files with 63 additions and 68 deletions
-18
View File
@@ -1,18 +0,0 @@
rm ~/Desktop/WITH-LOVE-FROM-AMERICA.txt
cd ~/actions-runner/_work/testdriver/testdriver/
brew install go
brew tap scripthaus-dev/scripthaus
brew install scripthaus
corepack enable
yarn install
scripthaus run build-backend
echo "Yarn"
yarn
echo "Rebuild"
scripthaus run electron-rebuild
echo "Webpack"
scripthaus run webpack-build
echo "Starting Electron"
scripthaus run electron 1>/dev/null 2>&1 &
echo "Electron Done"
exit
+29
View File
@@ -0,0 +1,29 @@
steps:
- step:
- command: focus-application
name: Electron
- command: hover-text
description: Get Started
action: click
- command: hover-text
description: Settings
action: click
- command: hover-text
description: 13px
action: click
- command: hover-text
description: 12px
action: click
- command: hover-text
description: Dark
action: click
- command: hover-text
description: Light
action: click
- command: hover-text
description: workspace-1
action: click
- step:
- command: assert
description: the terminal is white