Interaction

QAbyAI provides powerful interaction tools that let you simulate real user actions on web pages. These tools understand your intent and interact with elements intelligently.

AI Magic ✨

Give complex tasks in plain English and let AI figure out how to complete them.

Configuration:

• instruction (required): Natural language instruction for AI to execute

Extract and Save ✨

Extract content from the page and save it to variables for later use.

Configuration:

• prompt (required): Natural language description of what content to extract
• variableName (required): Variable name to save the extracted content for later use

Navigate

Navigate to any URL in your browser.

Configuration:

• url (required): URL to navigate to
• timeout (optional): Maximum time to wait for navigation

Click

Click on any element using natural descriptions.

Configuration:

• elementDescription (required): Description of element to click
• elementReference (optional): Direct element reference with DOM/UUID or XPath
• waitForDownload (optional): Whether to wait for a download after clicking
• downloadTimeout (optional): Maximum time to wait for download

Type

Type text into input fields, forms, or any editable elements.

Configuration:

• elementDescription (required): Description of input element to type into
• value (required): Text value to type
• replace (optional): Whether to replace existing value (default: append)
• pressEnter (optional): Whether to press Enter after typing
• elementReference (optional): Direct element reference with DOM/UUID or XPath

Select

Choose options from dropdowns, select lists, or combo boxes.

Configuration:

• elementDescription (required): Description of select/dropdown element
• option (required): Option text to select
• elementReference (optional): Direct element reference with DOM/UUID or XPath

Press

Press keyboard keys or key combinations.

Configuration:

• keys (required): Keyboard keys to press (e.g. "Enter", "Escape", "Ctrl+A")

Scroll

Scroll up or down on the page or within specific elements.

Configuration:

• vertical (required): Pixels to scroll vertically (positive=down, negative=up)
• elementDescription (optional): Description of element to hover over when scrolling
• elementReference (optional): Direct element reference with DOM/UUID or XPath

Hover

Hover over elements to trigger hover states or reveal hidden content.

Configuration:

• elementDescription (required): Description of element to hover over
• elementReference (optional): Direct element reference with DOM/UUID or XPath

File Upload

Upload files to file input elements.

Configuration:

• elementDescription (required): Description of file input element
• files (required): Array of files to upload with url and filename properties
• elementReference (optional): Direct element reference with DOM/UUID or XPath

All interaction tools work with QAbyAI's intelligent element detection - you don't need exact selectors, just describe what you want to interact with in natural language.