Click Screen Element Node

C

Automation/Computer/Mouse

Clicks an element by its id from the latest Capture Screen State of this session, through the accessibility action when possible, otherwise with the mouse at its center

computer_click_elementautomationLocal only

Inputs7

Outputs4

Security exposure3/10

Packageautomation

Ratings

Scores range from 0 to 10. Higher values mean more impact, exposure, or operational weight.

SecurityAttack surface and exposure impact.

3/10Low

PrivacyPotential sensitivity of processed data.

3/10Low

PerformanceRuntime or resource pressure.

8/10High

GovernancePolicy, audit, or compliance impact.

5/10Medium

ReliabilityOperational stability considerations.

8/10High

CostExternal or compute cost impact.

10/10High

Input Pins

7

▶

Execution

exec_in

Trigger

Session

Struct

session

Computer session handle

SchemaAutomationSessionAutomationSessionAutomationSession11 fields

session_refstringrequired

platformPlatformrequired

enum "Windows", "MacOS", "Linux"

default_delay_msinteger:uint64required

format uint64min 0

click_delay_msinteger:uint64required

format uint64min 0

debug_modebooleanrequired

browser_typeanyOf (2)

Browser context info if browser is attached

variant 1BrowserTypevariant

enum "Chrome", "Firefox", "Edge", "Safari"

variant 2nullvariant

browser_headlessboolean | null

browser_user_data_dirstring | null

current_page_refstring | null

Current page info if a page is open

current_window_handlestring | null

browser_frame_selectorsArray<Selector>

default []

itemsSelectorarray item

kindSelectorKindrequired

variant 1enumvariant

enum "Css", "Xpath", "TextExact", "TestId"...

variant 2constvariant

Visible text contained in the element; script, style and head content is ignored.

const "Text"

variant 3constvariant

ARIA role, optionally filtered by accessible name: `button`, `button|Sign in` (case-insensitive substring), `button|=Sign in` (exact) or `button|/^sign/i` (regex).

const "Role"

variant 4constvariant

Element ref from the latest Browser Snapshot, such as `e12`.

const "Ref"

valuestringrequired

confidencenumber | null

format double

scopestring | null

Element ID

Integer

element_id

The [id] from the screen state

Default 1

Generation

Integer

generation

Generation of the screen state the id comes from; 0 accepts the latest capture

Default 0

Button

String

button

Mouse button

Default left

leftrightmiddle

Double Click

Boolean

double

Click twice

Default false

Prefer Accessibility Action

Boolean

prefer_accessibility_action

Press accessibility elements through the accessibility API (works when covered or off-focus) for single left clicks; falls back to the mouse

Default true

Output Pins

4

▶

Execution

exec_out

Clicked

Session

Struct

session_out

Computer session handle (pass-through)

SchemaAutomationSessionAutomationSessionAutomationSession11 fields

session_refstringrequired

platformPlatformrequired

enum "Windows", "MacOS", "Linux"

default_delay_msinteger:uint64required

format uint64min 0

click_delay_msinteger:uint64required

format uint64min 0

debug_modebooleanrequired

browser_typeanyOf (2)

Browser context info if browser is attached

variant 1BrowserTypevariant

enum "Chrome", "Firefox", "Edge", "Safari"

variant 2nullvariant

browser_headlessboolean | null

browser_user_data_dirstring | null

current_page_refstring | null

Current page info if a page is open

current_window_handlestring | null

browser_frame_selectorsArray<Selector>

default []

itemsSelectorarray item

kindSelectorKindrequired

variant 1enumvariant

enum "Css", "Xpath", "TextExact", "TestId"...

variant 2constvariant

Visible text contained in the element; script, style and head content is ignored.

const "Text"

variant 3constvariant

ARIA role, optionally filtered by accessible name: `button`, `button|Sign in` (case-insensitive substring), `button|=Sign in` (exact) or `button|/^sign/i` (regex).

const "Role"

variant 4constvariant

Element ref from the latest Browser Snapshot, such as `e12`.

const "Ref"

valuestringrequired

confidencenumber | null

format double

scopestring | null

Element

Struct

element

The clicked element

SchemaScreenElementScreenElementScreenElement8 fields

idinteger:uint32required

1-based number drawn on the annotated image.

format uint32min 0

sourcestringrequired

`ax` (accessibility tree) or `ocr` (recognized text).

rolestringrequired

namestring | null

default null

valuestring | null

default null

statesArray<string>

default []

itemsstringarray item

bboxInputRectrequired

Visible part of the element.

xinteger:int32required

format int32

yinteger:int32required

format int32

widthinteger:uint32required

format uint32min 0

heightinteger:uint32required

format uint32min 0

centerInputPointrequired

xinteger:int32required

format int32

yinteger:int32required

format int32

Method

String

method

accessibility or mouse

Node Info

Internal name

computer_click_element

Category

Automation/Computer/Mouse

Version

1