Skip to content
Flow Like logo Flow Like Docs

LLM Describe Element Node

Automation/LLM/Vision

Uses vision LLM to describe a specific UI element at given coordinates

llm_describe_elementautomationLong running
Inputs7
Outputs3
Security exposure4/10
Packageautomation

Ratings

Scores range from 0 to 10. Higher values mean more impact, exposure, or operational weight.

SecurityAttack surface and exposure impact.
4/10Medium
PrivacyPotential sensitivity of processed data.
3/10Low
PerformanceRuntime or resource pressure.
5/10Medium
GovernancePolicy, audit, or compliance impact.
5/10Medium
ReliabilityOperational stability considerations.
7/10High
CostExternal or compute cost impact.
4/10Medium

Input Pins

7

▶

Execution
exec_in

Trigger

Model

Struct
model

Vision-capable LLM model

BitBit19 fields
idstring
default ""
typeBitTypes
enum "Llm", "Vlm", "Tts", "Stt"...default "Other"
metaMap<string, Metadata>
default {}
*Metadatamap value
namestringrequired
descriptionstringrequired
long_descriptionstring | null
release_notesstring | null
tagsArray<string>required
itemsstringarray item
+11 more fields
authorsArray<string>
default []
itemsstringarray item
repositorystring | null
default null
download_linkstring | null
default null
file_namestring | null
default null
hashstring
default ""
sizeinteger | null
format uint64default nullmin 0
hubstring
default ""
parametersvalue
default null
versionstring | null
default null
licensestring | null
default null
dependenciesArray<string>
default []
itemsstringarray item
dependency_tree_hashstring
default ""
createdstring
default ""
updatedstring
default ""
model_slugstring | null
default null
+1 more fields
Schema enforced

Screenshot

String
screenshot

Screenshot as base64 PNG, JPEG, WebP or GIF (a data URL is fine). Ignored when Image is connected

Image

Struct
image

Screenshot as an image, e.g. from the Screenshot node. Takes precedence over the base64 Screenshot

NodeImageNodeImage1 fields
image_refstringrequired

Frame

Struct
frame

Screen frame of the screenshot, from the capture node. Coordinates are desktop input coordinates (ready for the mouse nodes) when Frame is connected, otherwise pixels of the original screenshot

ScreenFrameScreenFrame7 fields
display_indexinteger | null
format uint32default nullmin 0
xinteger:int32required
format int32
yinteger:int32required
format int32
widthinteger:uint32required
format uint32min 0
heightinteger:uint32required
format uint32min 0
pixel_widthinteger:uint32required
format uint32min 0
pixel_heightinteger:uint32required
format uint32min 0

X

Integer
x

X coordinate of the element, in desktop input coordinates (ready for the mouse nodes) when Frame is connected, otherwise pixels of the original screenshot

Y

Integer
y

Y coordinate of the element, in desktop input coordinates (ready for the mouse nodes) when Frame is connected, otherwise pixels of the original screenshot

Output Pins

3

▶

Execution
exec_out

Continue

Element

Struct
element

Element description

ElementDescriptionElementDescription6 fields
element_typestringrequired
visual_descriptionstringrequired
purposestringrequired
current_statestringrequired
text_contentstring | null
accessibility_infostring | null

Description

String
description

Text description

Node Info

Internal name
llm_describe_element
Category
Automation/LLM/Vision
Version
4