Invoke Model Node

I

AI/Generative

Invokes the configured model with the provided chat history. Set history streaming off to preserve and replay structured media responses.

ai_generative_invokellmLong running

Inputs3

Outputs5

Security exposure5/10

Packagellm

Ratings

Scores range from 0 to 10. Higher values mean more impact, exposure, or operational weight.

SecurityAttack surface and exposure impact.

5/10Medium

PrivacyPotential sensitivity of processed data.

5/10Medium

PerformanceRuntime or resource pressure.

7/10High

GovernancePolicy, audit, or compliance impact.

5/10Medium

ReliabilityOperational stability considerations.

6/10Medium

CostExternal or compute cost impact.

5/10Medium

Input Pins

3

Input

Execution

exec_in

Trigger Pin

Model

Struct

model

Model

SchemaBitBitBit19 fields

idstring

default ""

typeBitTypes

enum "Llm", "Vlm", "Tts", "Stt"...default "Other"

metaMap<string, Metadata>

default {}

*Metadatamap value

namestringrequired

descriptionstringrequired

long_descriptionstring | null

release_notesstring | null

tagsArray<string>required

itemsstringarray item

+11 more fields

authorsArray<string>

default []

itemsstringarray item

repositorystring | null

default null

download_linkstring | null

default null

file_namestring | null

default null

hashstring

default ""

sizeinteger | null

format uint64default nullmin 0

hubstring

default ""

parametersvalue

default null

versionstring | null

default null

licensestring | null

default null

dependenciesArray<string>

default []

itemsstringarray item

dependency_tree_hashstring

default ""

createdstring

default ""

updatedstring

default ""

model_slugstring | null

default null

+1 more fields

Schema enforced

History

Struct

history

Chat History

SchemaHistoryHistoryHistory19 fields

modelstringrequired

messagesArray<HistoryMessage>required

itemsHistoryMessagearray item

roleRolerequired

enum "system", "user", "assistant", "function"...

contentMessageContentrequired

variant 1stringvariant

variant 2Array<Content>variant

namestring | null

tool_callsarray | null

itemsToolCallarray item

tool_call_idstring | null

+1 more fields

presetstring | null

streamboolean | null

stream_optionsanyOf (2)

variant 1StreamOptionsvariant

include_usagebooleanrequired

variant 2nullvariant

max_completion_tokensinteger | null

format uint32min 0

top_pnumber | null

format float

temperaturenumber | null

format float

thinkinganyOf (2)

variant 1HistoryThinkingvariant

enum "off", "low", "mid", "high"

variant 2nullvariant

seedinteger | null

format uint32min 0

presence_penaltynumber | null

format float

frequency_penaltynumber | null

format float

userstring | null

stoparray | null

itemsstringarray item

response_formatanyOf (2)

variant 1ResponseFormatvariant

variant 1stringvariant

variant 2nullvariant

ninteger | null

format uint32min 0

toolsarray | null

itemsToolarray item

typeToolTyperequired

enum "function"

functionHistoryFunctionrequired

namestringrequired

descriptionstring | null

parametersHistoryFunctionParametersrequired

tool_choiceanyOf (2)

variant 1ToolChoicevariant

variant 1nullvariant

variant 2nullvariant

variant 3nullvariant

variant 4objectvariant

typeToolTyperequired

enum "function"

functionHistoryFunctionrequired

variant 2nullvariant

+1 more fields

Schema enforced

Output Pins

5

On Stream

Execution

on_stream

Triggers on Streaming Output

Chunk

Struct

chunk

SchemaResponseChunkResponseChunkResponseChunk8 fields

idstringrequired

choicesArray<ResponseChunkChoice>required

itemsResponseChunkChoicearray item

indexinteger:int32required

format int32

deltaanyOf (2)

variant 1Deltavariant

variant 2nullvariant

finish_reasonstring | null

logprobsanyOf (2)

variant 1LogProbsvariant

variant 2nullvariant

createdinteger | null

format uint64min 0

modelstring | null

service_tierstring | null

system_fingerprintstring | null

usageanyOf (2)

variant 1Usagevariant

completion_tokensinteger:uint32required

format uint32min 0

prompt_tokensinteger:uint32required

format uint32min 0

total_tokensinteger:uint32required

format uint32min 0

costnumber | null

format double

prompt_tokens_detailsanyOf (2)

variant 1PromptTokenDetailsvariant

variant 2nullvariant

+2 more fields

variant 2nullvariant

x_prefill_progressnumber | null

format float

Schema enforced

Done

Execution

done

Done

Result

Struct

result

Resulting Model Output

SchemaResponseResponseResponse8 fields

idstring | null

choicesArray<Choice>required

itemsChoicearray item

indexinteger:int32required

format int32

finish_reasonstringrequired

messageResponseMessagerequired

rolestringrequired

contentstring | null

content_partsArray<Content>

Ordered structured content returned by Rig when the assistant response contains media. Text-only responses continue to use `content` alone for OpenAI compatibility.

refusalstring | null

annotationsarray | null

+3 more fields

logprobsanyOf (2)

variant 1LogProbsvariant

variant 2nullvariant

createdinteger | null

format uint64min 0

modelstring | null

service_tierstring | null

system_fingerprintstring | null

objectstring | null

usageUsagerequired

completion_tokensinteger:uint32required

format uint32min 0

prompt_tokensinteger:uint32required

format uint32min 0

total_tokensinteger:uint32required

format uint32min 0

costnumber | null

format double

prompt_tokens_detailsanyOf (2)

variant 1PromptTokenDetailsvariant

cached_tokensinteger | null

format uint32min 0

audio_tokensinteger | null

format uint32min 0

variant 2nullvariant

+2 more fields

Schema enforced

Stats

Struct

stats

Token usage, cost, and model statistics

SchemaLLMUsageStatsLLMUsageStatsLLMUsageStats5 fields

usageUsagerequired

completion_tokensinteger:uint32required

format uint32min 0

prompt_tokensinteger:uint32required

format uint32min 0

total_tokensinteger:uint32required

format uint32min 0

costnumber | null

format double

prompt_tokens_detailsanyOf (2)

variant 1PromptTokenDetailsvariant

cached_tokensinteger | null

format uint32min 0

audio_tokensinteger | null

format uint32min 0

variant 2nullvariant

+2 more fields

modelstring | null

duration_msinteger | null

format uint64min 0

iterationsinteger | null

format uint32min 0

callsArray<ModelCallEntry>

itemsModelCallEntryarray item

modelstringrequired

usageUsagerequired

completion_tokensinteger:uint32required

format uint32min 0

prompt_tokensinteger:uint32required

format uint32min 0

total_tokensinteger:uint32required

format uint32min 0

costnumber | null

format double

prompt_tokens_detailsanyOf (2)

+2 more fields

duration_msinteger | null

format uint64min 0

Schema enforced

Node Info

Internal name

ai_generative_invoke

Category

AI/Generative

Version

4