Find Text on Screen Node

F

Automation/Computer/Vision

Finds text on a display, region or window with OCR and returns its position in desktop coordinates

computer_find_textautomationLocal only

Inputs14

Outputs10

Security exposure5/10

Packageautomation

Ratings

Scores range from 0 to 10. Higher values mean more impact, exposure, or operational weight.

SecurityAttack surface and exposure impact.

5/10Medium

PrivacyPotential sensitivity of processed data.

4/10Medium

PerformanceRuntime or resource pressure.

6/10Medium

GovernancePolicy, audit, or compliance impact.

6/10Medium

ReliabilityOperational stability considerations.

7/10High

CostExternal or compute cost impact.

10/10High

Input Pins

14

▶

Execution

exec_in

Trigger

Session

Struct

session

Computer session handle

SchemaAutomationSessionAutomationSessionAutomationSession11 fields

session_refstringrequired

platformPlatformrequired

enum "Windows", "MacOS", "Linux"

default_delay_msinteger:uint64required

format uint64min 0

click_delay_msinteger:uint64required

format uint64min 0

debug_modebooleanrequired

browser_typeanyOf (2)

Browser context info if browser is attached

variant 1BrowserTypevariant

enum "Chrome", "Firefox", "Edge", "Safari"

variant 2nullvariant

browser_headlessboolean | null

browser_user_data_dirstring | null

current_page_refstring | null

Current page info if a page is open

current_window_handlestring | null

browser_frame_selectorsArray<Selector>

default []

itemsSelectorarray item

kindSelectorKindrequired

variant 1enumvariant

enum "Css", "Xpath", "TextExact", "TestId"...

variant 2constvariant

Visible text contained in the element; script, style and head content is ignored.

const "Text"

variant 3constvariant

ARIA role, optionally filtered by accessible name: `button`, `button|Sign in` (case-insensitive substring), `button|=Sign in` (exact) or `button|/^sign/i` (regex).

const "Role"

variant 4constvariant

Element ref from the latest Browser Snapshot, such as `e12`.

const "Ref"

valuestringrequired

confidencenumber | null

format double

scopestring | null

Text

String

text

Text or pattern to find

Match Mode

String

match_mode

exact: whole words equal the text; contains: substring; regex: pattern; fuzzy: similar words

Default exact

exactcontainsregexfuzzy

Case Sensitive

Boolean

case_sensitive

Compare letter case; whitespace and typographic quotes are always normalized

Default false

Fuzzy Threshold

Float

fuzzy_threshold

Minimum similarity (0–1) for fuzzy matches

Default 0.8

Range 0 to 1Step 0.05

Occurrence

Integer

occurrence

Which match to use in reading order (1 = first)

Default 1

Range 1 to 1000Step 1

Window Title

String

window_title

Look only inside the window with this title; empty uses the region or display

Display Index

Integer

display_index

Display to capture when no window or region is given

Default 0

Region X

Integer

region_x

Left edge of the region in desktop input coordinates

Default 0

Region Y

Integer

region_y

Top edge of the region in desktop input coordinates

Default 0

Region Width

Integer

region_width

Region width; 0 captures the whole display

Default 0

Region Height

Integer

region_height

Region height; 0 captures the whole display

Default 0

Languages

String

languages

Comma-separated languages such as en-US, de; empty lets the OS engine choose

Output Pins

10

▶

Execution

exec_out

The text was found

Not Found

Execution

exec_not_found

The text is not on screen

Session

Struct

session_out

Computer session handle (pass-through)

SchemaAutomationSessionAutomationSessionAutomationSession11 fields

session_refstringrequired

platformPlatformrequired

enum "Windows", "MacOS", "Linux"

default_delay_msinteger:uint64required

format uint64min 0

click_delay_msinteger:uint64required

format uint64min 0

debug_modebooleanrequired

browser_typeanyOf (2)

Browser context info if browser is attached

variant 1BrowserTypevariant

enum "Chrome", "Firefox", "Edge", "Safari"

variant 2nullvariant

browser_headlessboolean | null

browser_user_data_dirstring | null

current_page_refstring | null

Current page info if a page is open

current_window_handlestring | null

browser_frame_selectorsArray<Selector>

default []

itemsSelectorarray item

kindSelectorKindrequired

variant 1enumvariant

enum "Css", "Xpath", "TextExact", "TestId"...

variant 2constvariant

Visible text contained in the element; script, style and head content is ignored.

const "Text"

variant 3constvariant

ARIA role, optionally filtered by accessible name: `button`, `button|Sign in` (case-insensitive substring), `button|=Sign in` (exact) or `button|/^sign/i` (regex).

const "Role"

variant 4constvariant

Element ref from the latest Browser Snapshot, such as `e12`.

const "Ref"

valuestringrequired

confidencenumber | null

format double

scopestring | null

Found

Boolean

found

Whether the requested occurrence exists

X

Integer

x

Center X of the match in desktop input coordinates

Y

Integer

y

Center Y of the match in desktop input coordinates

Bounds

Struct

bbox

Bounds of the match in desktop input coordinates

SchemaInputRectInputRectInputRect4 fields

xinteger:int32required

format int32

yinteger:int32required

format int32

widthinteger:uint32required

format uint32min 0

heightinteger:uint32required

format uint32min 0

Match

Struct

match

The selected match

SchemaTextMatchTextMatchTextMatch7 fields

textstringrequired

The matched words as recognized.

line_textstringrequired

scorenumber:doublerequired

1 for exact, contains and regex matches; the similarity for fuzzy matches.

format double

confidencenumber | null

format doubledefault null

bbox_pxPixelBoxrequired

A rectangle in image pixels, origin top-left.

xinteger:uint32required

format uint32min 0

yinteger:uint32required

format uint32min 0

widthinteger:uint32required

format uint32min 0

heightinteger:uint32required

format uint32min 0

bboxanyOf (2)

default null

variant 1InputRectvariant

A rectangle in desktop input coordinates, the space the mouse nodes use.

xinteger:int32required

format int32

yinteger:int32required

format int32

widthinteger:uint32required

format uint32min 0

heightinteger:uint32required

format uint32min 0

variant 2nullvariant

centeranyOf (2)

default null

variant 1InputPointvariant

xinteger:int32required

format int32

yinteger:int32required

format int32

variant 2nullvariant

All Matches

Struct Array

matches

Every match in reading order

SchemaTextMatchTextMatchTextMatch7 fields

textstringrequired

The matched words as recognized.

line_textstringrequired

scorenumber:doublerequired

1 for exact, contains and regex matches; the similarity for fuzzy matches.

format double

confidencenumber | null

format doubledefault null

bbox_pxPixelBoxrequired

A rectangle in image pixels, origin top-left.

xinteger:uint32required

format uint32min 0

yinteger:uint32required

format uint32min 0

widthinteger:uint32required

format uint32min 0

heightinteger:uint32required

format uint32min 0

bboxanyOf (2)

default null

variant 1InputRectvariant

A rectangle in desktop input coordinates, the space the mouse nodes use.

xinteger:int32required

format int32

yinteger:int32required

format int32

widthinteger:uint32required

format uint32min 0

heightinteger:uint32required

format uint32min 0

variant 2nullvariant

centeranyOf (2)

default null

variant 1InputPointvariant

xinteger:int32required

format int32

yinteger:int32required

format int32

variant 2nullvariant

Frame

Struct

frame

Screen frame of the searched capture

SchemaScreenFrameScreenFrameScreenFrame7 fields

display_indexinteger | null

format uint32default nullmin 0

xinteger:int32required

format int32

yinteger:int32required

format int32

widthinteger:uint32required

format uint32min 0

heightinteger:uint32required

format uint32min 0

pixel_widthinteger:uint32required

format uint32min 0

pixel_heightinteger:uint32required

format uint32min 0

Node Info

Internal name

computer_find_text

Category

Automation/Computer/Vision

Version

1