autoqa plan 每次都会失败

[pengxiang01]

这是我的
autoqa.config.json {
"schemaVersion": 1,
"guardrails": {
"maxToolCallsPerSpec": 200,
"maxConsecutiveErrors": 8,
"maxRetriesPerStep": 5
},
"exportDir": "tests/autoqa",
"plan": {
"baseUrl": "http://127.0.0.1:10086/#",
"maxDepth": 3,
"maxPages": 50,
"includePatterns": ["/lattePrinter"],
"excludePatterns": ["/dashboard", "/develop", "/components", "/dymaic","/permission","/system","/cms","/member"],
"testTypes": ["functional", "form", "navigation", "responsive", "boundary", "security"],
"auth": {
"loginUrl": "http://127.0.0.1:10086/#/login",
"username": "catch@admin.com",
"password": "catchadmin"
},
"guardrails": {
"maxAgentTurnsPerRun": 1000,
"maxSnapshotsPerRun": 500,
"maxPagesPerRun": 100,
"maxTokenPerRun": 5000000
}
}
}
这是测试日志：
zero@192 malong-servers % autoqa plan
🔍 Starting exploration...
[explore] Finished iterating over response
[explore] Total messages processed: 106
[explore] Total turns processed: 106
[explore] Last error: None
[explore] Agent output length: 27811
[explore] Agent output preview (first 1000 chars):
I'll start by navigating to the login URL and taking a snapshot to see the login form structure.
I can see the login form is already filled with the credentials. Now I'll click the login button to submit the form.
Great! Login was successful. I'm now on the dashboard page. I can see there are multiple menu items available. Let me start exploring the navigation systematically. I'll click through each main menu item to discover the pages.
I can see the "开发工具" menu has expanded to show two sub-items: "模块管理" and "Schemas". Let me click on "模块管理" first.
Good! I can see the Module Management page. Now let me click on "Schemas" under the Development Tools menu.
Now let me explore the "组件演示" (Component Demo) menu item.
Good! The Component Demo menu has expanded to show 7 sub-items. Let me click on "动态表单" (Dynamic Form) to continue exploring.
Good! The Dynamic Form menu has expanded with 2 sub-items. Now let me explore "权限管理" (Permission Management).
Good! The Permission Management menu has 5 s
[explore] Agent output preview (last 500 chars):
rom": "p1", "to": "p2", "trigger": "submit", "elementRef": "e5"},
{"from": "p2", "to": "p3", "trigger": "click", "elementRef": "e7"},
{"from": "p3", "to": "p4", "trigger": "click", "elementRef": "e30"},
{"from": "p2", "to": "p5", "trigger": "click", "elementRef": "e14"},
{"from": "p2", "to": "p6", "trigger": "click", "elementRef": "e10"},
{"from": "p2", "to": "p7", "trigger": "click", "elementRef": "e11"}
],
"loginStatus": {
"attempted": true,
"ok": true
}
}

✅ Exploration completed
📊 Pages visited: 7
📁 Exploration results: .autoqa/runs/b590e60c-eb10-4380-98cc-f518a8746e3a/plan-explore/

📋 Generating test cases...
❌ Plan command failed: Planner Agent returned no test cases in TestPlan
zero@192 malong-servers % 

[terryso]

好像没有生成任何用例, 你先把 "includePatterns": ["/lattePrinter"],
"excludePatterns": ["/dashboard", "/develop", "/components", "/dymaic","/permission","/system","/cms","/member"]

这两个字段设置为空数组

"baseUrl": "http://127.0.0.1:10086/#", 改成 "baseUrl": "http://127.0.0.1:10086",

重新跑试试.

或者你先用 https://www.saucedemo.com 这个URL 来试试, 我没有你的本地网站, 无法确定是什么问题

[pengxiang01]

测试了https://www.saucedemo.com/ 还是一样的错误 zero@192 test % autoqa plan
🔍 Starting exploration...
[explore] Finished iterating over response
[explore] Total messages processed: 168
[explore] Total turns processed: 168
[explore] Last error: None
[explore] Agent output length: 21675
[explore] Agent output preview (first 1000 chars):
I'll start by navigating to the login URL and capturing the initial page structure.
Let me try taking a snapshot with a different approach - wait a moment for the page to load first.
Let me try navigating to the base URL first and see if that works better.
Perfect! I can see the login page. Now I'll fill in the credentials and log in.
Excellent! Login successful. I can see the Products page (Inventory page). Now let me explore the menu and other navigation elements.
Good! I can see the menu options. Now let me check if there's a shopping cart. I notice there's no cart icon visible yet. Let me close the menu and look for the cart or check the page structure more carefully.
I notice the cart icon is not showing in the snapshot. Let me scroll up to see if there's a cart icon at the top of the page.
The cart icon might be between the menu and title. Let me try clicking on a product link to navigate to a product detail page. This will be depth level 1.
Great! I'm now on a product detail pag
[explore] Agent output preview (last 500 chars):
m": "p4", "to": "p5", "trigger": "click", "elementRef": "e24"},
{"from": "p5", "to": "p4", "trigger": "click", "elementRef": "e29"},
{"from": "p5", "to": "p6", "trigger": "submit", "elementRef": "e30"},
{"from": "p6", "to": "p2", "trigger": "click", "elementRef": "e31"},
{"from": "p6", "to": "p7", "trigger": "click", "elementRef": "e32"},
{"from": "p7", "to": "p2", "trigger": "click", "elementRef": "e33"}
],
"loginStatus": {
"attempted": true,
"ok": true
}
}

✅ Exploration completed
📊 Pages visited: 7
📁 Exploration results: .autoqa/runs/b970078a-1748-4204-8af3-33f39b3011a8/plan-explore/

📋 Generating test cases...
❌ Plan command failed: Planner Agent returned no test cases in TestPlan
zero@192 test % 

[terryso]

.autoqa/runs/b970078a-1748-4204-8af3-33f39b3011a8 把这个目录下所有文件打包一个zip包传上来看看

[anstarword]

我也碰到这个问题了，每次explore提示成功，但generate提示失败。
碰到过一次这个错：
autoqa plan --url https://www.saucedemo.com/
[autoqa.plan] CLI options overriding config file values: url
🔍 Starting exploration...
[explore] Finished iterating over response
[explore] Total messages processed: 156
[explore] Total turns processed: 156
[explore] Last error: None
[explore] Agent output length: 38226
[explore] Agent output preview (first 1000 chars):
I'll start exploring the web application at https://www.saucedemo.com/. Let me begin by navigating to the base URL and capturing the initial page structure.
Now let me capture a snapshot of the login page to see its structure.
Good! I can see the login page structure. This is a login form with username and password fields. Let me document this page and then attempt to login to explore the authenticated areas of the site.
... ...
... ...
**Page 2 - Products/Invent
[explore] Agent output preview (last 500 chars):
"elementRef": "e39"},
{"from": "p11", "to": "p9", "trigger": "click", "elementRef": "e41"},
{"from": "p11", "to": "p12", "trigger": "click", "elementRef": "e42"},
{"from": "p12", "to": "p2", "trigger": "click", "elementRef": "e44"}
],
"loginStatus": {
"attempted": true,
"ok": true
}
}

📋 Generating test cases...
❌ Plan command failed: Failed to parse TestPlan JSON: Expected double-quoted property name in JSON at position 28940 (line 954 column 61)

碰到过几次这个错:
The application follows a typical e-commerce flow: Login → Browse Products → View Product Details → Add to Cart → Checkout (Information) → Checkout (Overview) → Order Complete.

✅ Exploration completed
📊 Pages visited: 6
📁 Exploration results: .autoqa/runs/2e0f456d-fcc2-417e-b641-fcf3be229c14/plan-explore/

📋 Generating test cases...
❌ Plan command failed: Planner Agent returned no test cases in TestPlan