Skip to content

LLM Heal Template Node

Automation/LLM/Healing

Uses vision LLM to find a visually similar element when template matching fails

llm_heal_templateautomationLong running
Inputs8
Outputs5
Security exposure4/10
Packageautomation

Ratings

Scores range from 0 to 10. Higher values mean more impact, exposure, or operational weight.

SecurityAttack surface and exposure impact.
4/10Medium
PrivacyPotential sensitivity of processed data.
3/10Low
PerformanceRuntime or resource pressure.
4/10Medium
GovernancePolicy, audit, or compliance impact.
5/10Medium
ReliabilityOperational stability considerations.
7/10High
CostExternal or compute cost impact.
5/10Medium

Input Pins

8

▶

Execution
exec_in

Trigger

Model

Struct
model

Vision-capable LLM model

BitBit19 fields
idstring
default ""
typeBitTypes
enum "Llm", "Vlm", "Tts", "Stt"...default "Other"
metaMap<string, Metadata>
default {}
*Metadatamap value
namestringrequired
descriptionstringrequired
long_descriptionstring | null
release_notesstring | null
tagsArray<string>required
itemsstringarray item
+11 more fields
authorsArray<string>
default []
itemsstringarray item
repositorystring | null
default null
download_linkstring | null
default null
file_namestring | null
default null
hashstring
default ""
sizeinteger | null
format uint64default nullmin 0
hubstring
default ""
parametersvalue
default null
versionstring | null
default null
licensestring | null
default null
dependenciesArray<string>
default []
itemsstringarray item
dependency_tree_hashstring
default ""
createdstring
default ""
updatedstring
default ""
model_slugstring | null
default null
+1 more fields
Schema enforced

Screenshot

String
screenshot

Current screenshot as base64 PNG, JPEG, WebP or GIF (a data URL is fine). Ignored when Image is connected

Image

Struct
image

Current screenshot as an image, e.g. from the Screenshot node. Takes precedence over the base64 Screenshot

NodeImageNodeImage1 fields
image_refstringrequired

Frame

Struct
frame

Screen frame of the screenshot, from the capture node. Coordinates are desktop input coordinates (ready for the mouse nodes) when Frame is connected, otherwise pixels of the original screenshot

ScreenFrameScreenFrame7 fields
display_indexinteger | null
format uint32default nullmin 0
xinteger:int32required
format int32
yinteger:int32required
format int32
widthinteger:uint32required
format uint32min 0
heightinteger:uint32required
format uint32min 0
pixel_widthinteger:uint32required
format uint32min 0
pixel_heightinteger:uint32required
format uint32min 0

Template

String
template

Base64-encoded template image (PNG, JPEG, WebP or GIF) that failed to match

Element Description

String
element_description

Description of what the template represents

Last Known Position

String
last_known_position

Where the element was previously found (x,y in desktop input coordinates (ready for the mouse nodes) when Frame is connected, otherwise pixels of the original screenshot)

Output Pins

5

▶

Execution
exec_out

Continue

Failed

Execution
exec_failed

Could not heal, or the model gave no point on the screenshot

Result

Struct
result

Healed template result; points and regions are in desktop input coordinates (ready for the mouse nodes) when Frame is connected, otherwise pixels of the original screenshot

HealedTemplateHealedTemplate7 fields
healedbooleanrequired
found_at_xinteger | null
format int32
found_at_yinteger | null
format int32
confidencenumber:doublerequired
format double
reasoningstringrequired
suggested_regionanyOf (2)
variant 1TemplateRegionvariant
xinteger:int32required
format int32
yinteger:int32required
format int32
widthinteger:int32required
format int32
heightinteger:int32required
format int32
variant 2nullvariant
visual_changes_detectedArray<string>
default []
itemsstringarray item

X

Integer
x

X coordinate of the found element's center, in desktop input coordinates (ready for the mouse nodes) when Frame is connected, otherwise pixels of the original screenshot

Y

Integer
y

Y coordinate of the found element's center, in desktop input coordinates (ready for the mouse nodes) when Frame is connected, otherwise pixels of the original screenshot

Node Info

Internal name
llm_heal_template
Category
Automation/LLM/Healing
Version
4