You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: cli/test-suites-and-reports.md
+77
Original file line number
Diff line number
Diff line change
@@ -112,3 +112,80 @@ Note that your Flows should **not** depend on device state and should be treated
112
112
#### Configuring part of the Flows to run sequentially
113
113
114
114
For instance, if you have three Flows, `flowA`, `flowB`, and `flowC`, but you want to run only `flowA` and `flowB` sequentially, don't add `flowC` and `flowD` to the list. Maestro will run these Flows in non-deterministic ordering **after** the Flow sequence has finished executing.
115
+
116
+
#### Analyze
117
+
118
+
{% hint style="warning" %}
119
+
120
+
This is an **experimental** feature powered by LLM technology. All feedback is
121
+
welcome.
122
+
123
+
{% endhint %}
124
+
125
+
Maestro introduces a new feature that leverages AI to analyze your end-to-end (E2E) mobile tests and provide actionable insights based on your test logs, commands, and screenshots captured during your test runs. The AI-powered analysis identifies potential issues in your app's functionality, UI, and internationalization, helping you improve app quality efficiently.
126
+
127
+
**Login Requirement:** Before you use the AI analysis feature, ensure you are logged into Maestro. Run the following command:
128
+
129
+
```bash
130
+
maestro login
131
+
```
132
+
133
+
> Quick Note: You don't need to be a paying customer to try out this feature. Users on the 7-day trial can also leverage this capability.
134
+
135
+
**Analyzing your tests**: To analyze your test flows with AI, use the --analyze flag with the maestro test command:
136
+
137
+
```bash
138
+
maestro test flow-file.yaml --analyze
139
+
```
140
+
141
+
{% hint style="info" %}
142
+
143
+
While we aim for precision, please note that this is a beta release, and the results should be validated before making critical decision
144
+
145
+
{% endhint %}
146
+
147
+
This will enable AI analysis and provide a detailed report based on your test artifacts:
148
+
149
+
##### Examples
150
+
151
+
Successful Analysis
152
+
153
+
Command:
154
+
155
+
```bash
156
+
maestro test flow-file.yaml --analyze
157
+
```
158
+
159
+
Output:
160
+
161
+
```bash
162
+
🔎 Analyzing Flow(s)...
163
+
164
+
To view the report, open the following link in your browser:
165
+
file:///path/to/your/insights-report.html
166
+
167
+
Analyze support is in Beta. We would appreciate your feedback in our Slack channel: #community-chat
The Analyze feature is currently in Beta. Share your feedback and suggestions in our Slack channel:[#community-chat](https://mobile-dev-inc.slack.com/archives/C083YB8N42G)
0 commit comments