Skip to content

Fix NetworkEventEvaluator false negatives for shopping category navigation#37

Open
Soulike wants to merge 1 commit intoServiceNow:mainfrom
Soulike:main
Open

Fix NetworkEventEvaluator false negatives for shopping category navigation#37
Soulike wants to merge 1 commit intoServiceNow:mainfrom
Soulike:main

Conversation

@Soulike
Copy link

@Soulike Soulike commented Mar 10, 2026

Summary

  • Add alternative sidebar URLs (?cat=XX format) for 14 shopping tasks (261-264, 269-273, 351-355) that previously only accepted navigation bar SEO URLs
  • The shopping site allows navigating to category pages via two equivalent paths: the navigation bar hover menu (SEO URLs like /electronics/headphones.html) and the left sidebar (query parameter URLs like /electronics.html?cat=60). Both lead to the same page, but the evaluator only accepted the SEO URL format, causing false negatives.

Fixes #36

…ation

Add alternative sidebar URLs (?cat=XX format) for 14 shopping tasks
(261-264, 269-273, 351-355) that previously only accepted navigation
bar SEO URLs, causing false negatives when agents used the left sidebar
to reach the same category pages.

Fixes ServiceNow#36

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@Soulike Soulike requested a review from Am1n3e as a code owner March 10, 2026 09:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Multiple Category-Related Shopping Cases Fail when Navigate to ?cat=ID URLs

1 participant