LLM Suggest Next Step Node

L

Automation/LLM/Planning

Uses LLM to suggest the most appropriate next action given current screen and goal

llm_suggest_next_stepautomationLong running

Inputs8

Outputs5

Security exposure4/10

Packageautomation

Ratings

Scores range from 0 to 10. Higher values mean more impact, exposure, or operational weight.

SecurityAttack surface and exposure impact.

4/10Medium

PrivacyPotential sensitivity of processed data.

3/10Low

PerformanceRuntime or resource pressure.

4/10Medium

GovernancePolicy, audit, or compliance impact.

5/10Medium

ReliabilityOperational stability considerations.

6/10Medium

CostExternal or compute cost impact.

5/10Medium

Input Pins

8

▶

Execution

exec_in

Trigger

Model

Struct

model

Vision-capable LLM model

SchemaBitBitBit19 fields

idstring

default ""

typeBitTypes

enum "Llm", "Vlm", "Tts", "Stt"...default "Other"

metaMap<string, Metadata>

default {}

*Metadatamap value

namestringrequired

descriptionstringrequired

long_descriptionstring | null

release_notesstring | null

tagsArray<string>required

itemsstringarray item

+11 more fields

authorsArray<string>

default []

itemsstringarray item

repositorystring | null

default null

download_linkstring | null

default null

file_namestring | null

default null

hashstring

default ""

sizeinteger | null

format uint64default nullmin 0

hubstring

default ""

parametersvalue

default null

versionstring | null

default null

licensestring | null

default null

dependenciesArray<string>

default []

itemsstringarray item

dependency_tree_hashstring

default ""

createdstring

default ""

updatedstring

default ""

model_slugstring | null

default null

+1 more fields

Schema enforced

Screenshot

String

screenshot

Current screenshot as base64 PNG, JPEG, WebP or GIF (a data URL is fine). Ignored when Image is connected

Image

Struct

image

Current screenshot as an image, e.g. from the Screenshot node. Takes precedence over the base64 Screenshot

SchemaNodeImageNodeImageNodeImage1 fields

image_refstringrequired

Frame

Struct

frame

Screen frame of the screenshot, from the capture node. Coordinates are desktop input coordinates (ready for the mouse nodes) when Frame is connected, otherwise pixels of the original screenshot

SchemaScreenFrameScreenFrameScreenFrame7 fields

display_indexinteger | null

format uint32default nullmin 0

xinteger:int32required

format int32

yinteger:int32required

format int32

widthinteger:uint32required

format uint32min 0

heightinteger:uint32required

format uint32min 0

pixel_widthinteger:uint32required

format uint32min 0

pixel_heightinteger:uint32required

format uint32min 0

Goal

String

goal

Ultimate goal we're trying to achieve

Completed Actions

String

completed_actions

JSON array of actions already taken

Default []

Last Result

String

last_result

Result/outcome of the last action

Output Pins

5

▶

Execution

exec_out

Continue

Goal Reached

Execution

exec_goal_reached

Goal appears to be achieved

Suggestion

Struct

suggestion

Next step suggestion; target_coordinates are in desktop input coordinates (ready for the mouse nodes) when Frame is connected, otherwise pixels of the original screenshot

SchemaNextStepSuggestionNextStepSuggestionNextStepSuggestion7 fields

action_typestringrequired

target_descriptionstringrequired

target_coordinatesarray | null

Target point: desktop input coordinates when a frame was connected, otherwise screenshot pixels.

parametersvalue

default null

reasoningstringrequired

confidencenumber:doublerequired

format double

alternativesArray<AlternativeAction>

default []

itemsAlternativeActionarray item

action_typestringrequired

descriptionstringrequired

confidencenumber:doublerequired

format double

Action Type

String

action_type

Type of suggested action

Target

String

target

Target description

Node Info

Internal name

llm_suggest_next_step

Category

Automation/LLM/Planning

Version

4