feat: enhance snapshot usability by reducing AI cognitive load of semantic noise and -C flag (#968)
* fix: add ref for cursor-interactive content roles * fix: format * feat: always include cursor-interactive elements in snapshot, -C is deprecated * feat: process StaticText aggregation and deduplication * update test * clean up * fix: escape text of elements in snapshot * fix: redundant slicing * fix: cargo fmt * feat: deduplicate redundant StaticText --------- Co-authored-by: 羲洋 <lipengyang.lpy@alibaba-inc.com>
This commit is contained in:
@@ -113,7 +113,6 @@ agent-browser close # Close browser
|
||||
|
||||
# Snapshot
|
||||
agent-browser snapshot -i # Interactive elements with refs (recommended)
|
||||
agent-browser snapshot -i -C # Include cursor-interactive elements (divs with onclick, cursor:pointer)
|
||||
agent-browser snapshot -s "#selector" # Scope to CSS selector
|
||||
|
||||
# Interaction (use @refs from snapshot)
|
||||
|
||||
@@ -217,7 +217,6 @@ AGENT_BROWSER_COLOR_SCHEME=dark agent-browser connect 9222
|
||||
### Elements not appearing in snapshot
|
||||
|
||||
- The app may use multiple webviews. Use `agent-browser tab` to list targets and switch to the right one
|
||||
- Use `agent-browser snapshot -i -C` to include cursor-interactive elements (divs with onclick handlers)
|
||||
|
||||
### Cannot type in input fields
|
||||
|
||||
|
||||
@@ -235,15 +235,6 @@ agent-browser console
|
||||
agent-browser errors
|
||||
```
|
||||
|
||||
### View raw HTML of an element
|
||||
|
||||
```bash
|
||||
# Snapshot shows the accessibility tree. If an element isn't there,
|
||||
# it may not be interactive (e.g., div instead of button)
|
||||
# Use snapshot -i -C to include cursor-interactive divs
|
||||
agent-browser snapshot -i -C
|
||||
```
|
||||
|
||||
### Get current page state
|
||||
|
||||
```bash
|
||||
|
||||
@@ -334,19 +334,13 @@ If you can't find an element:
|
||||
agent-browser snapshot -i
|
||||
```
|
||||
|
||||
3. **Try snapshot with extended range**
|
||||
```bash
|
||||
# Include cursor-interactive elements (divs with onclick handlers)
|
||||
agent-browser snapshot -i -C
|
||||
```
|
||||
|
||||
4. **Check current URL**
|
||||
3. **Check current URL**
|
||||
```bash
|
||||
agent-browser get url
|
||||
# Verify you're in the right section
|
||||
```
|
||||
|
||||
5. **Wait for page to load**
|
||||
4. **Wait for page to load**
|
||||
```bash
|
||||
agent-browser wait --load networkidle
|
||||
agent-browser wait 1000
|
||||
|
||||
Reference in New Issue
Block a user