Skip to content
Flow Like logo Flow Like Docs

Invoke Model Node

AI/Generative

Invoke Model

Invokes the configured model with the provided chat history and streams back chunks.

ai_generative_invokellmLong running
Inputs3
Outputs5
Security exposure5/10
Packagellm

Ratings

Scores range from 0 to 10. Higher values mean more impact, exposure, or operational weight.

SecurityAttack surface and exposure impact.
5/10Medium
PrivacyPotential sensitivity of processed data.
5/10Medium
PerformanceRuntime or resource pressure.
3/10High
GovernancePolicy, audit, or compliance impact.
5/10Medium
ReliabilityOperational stability considerations.
4/10Medium
CostExternal or compute cost impact.
5/10Medium

Input Pins

3

Input

Execution
exec_in

Trigger Pin

Model

Struct
model

Model

BitBit19 fields
idstring
default ""
typeBitTypes
enum "Llm", "Vlm", "Tts", "Stt"...default "Other"
metaMap<string, Metadata>
default {}
*Metadatamap value
namestringrequired
descriptionstringrequired
long_descriptionstring | null
release_notesstring | null
tagsArray<string>required
itemsstringarray item
+11 more fields
authorsArray<string>
default []
itemsstringarray item
repositorystring | null
default null
download_linkstring | null
default null
file_namestring | null
default null
hashstring
default ""
sizeinteger | null
format uint64default nullmin 0
hubstring
default ""
parametersvalue
default null
versionstring | null
default null
licensestring | null
default null
dependenciesArray<string>
default []
itemsstringarray item
dependency_tree_hashstring
default ""
createdstring
default ""
updatedstring
default ""
model_slugstring | null
default null
+1 more fields
Schema enforced

History

Struct
history

Chat History

HistoryHistory19 fields
modelstringrequired
messagesArray<HistoryMessage>required
itemsHistoryMessagearray item
roleRolerequired
enum "system", "user", "assistant", "function"...
contentMessageContentrequired
variant 1stringvariant
variant 2Array<Content>variant
namestring | null
tool_callsarray | null
itemsToolCallarray item
tool_call_idstring | null
+1 more fields
presetstring | null
streamboolean | null
stream_optionsanyOf (2)
variant 1StreamOptionsvariant
include_usagebooleanrequired
variant 2nullvariant
max_completion_tokensinteger | null
format uint32min 0
top_pnumber | null
format float
temperaturenumber | null
format float
thinkinganyOf (2)
variant 1HistoryThinkingvariant
enum "off", "low", "mid", "high"
variant 2nullvariant
seedinteger | null
format uint32min 0
presence_penaltynumber | null
format float
frequency_penaltynumber | null
format float
userstring | null
stoparray | null
itemsstringarray item
response_formatanyOf (2)
variant 1ResponseFormatvariant
variant 1stringvariant
variant 2nullvariant
ninteger | null
format uint32min 0
toolsarray | null
itemsToolarray item
typeToolTyperequired
enum "function"
functionHistoryFunctionrequired
namestringrequired
descriptionstring | null
parametersHistoryFunctionParametersrequired
tool_choiceanyOf (2)
variant 1ToolChoicevariant
variant 1nullvariant
variant 2nullvariant
variant 3nullvariant
variant 4objectvariant
typeToolTyperequired
enum "function"
functionHistoryFunctionrequired
variant 2nullvariant
+1 more fields
Schema enforced

Output Pins

5

On Stream

Execution
on_stream

Triggers on Streaming Output

Chunk

Struct
chunk
ResponseChunkResponseChunk8 fields
idstringrequired
choicesArray<ResponseChunkChoice>required
itemsResponseChunkChoicearray item
indexinteger:int32required
format int32
deltaanyOf (2)
variant 1Deltavariant
variant 2nullvariant
finish_reasonstring | null
logprobsanyOf (2)
variant 1LogProbsvariant
variant 2nullvariant
createdinteger | null
format uint64min 0
modelstring | null
service_tierstring | null
system_fingerprintstring | null
usageanyOf (2)
variant 1Usagevariant
completion_tokensinteger:uint32required
format uint32min 0
prompt_tokensinteger:uint32required
format uint32min 0
total_tokensinteger:uint32required
format uint32min 0
costnumber | null
format double
prompt_tokens_detailsanyOf (2)
variant 1PromptTokenDetailsvariant
variant 2nullvariant
+2 more fields
variant 2nullvariant
x_prefill_progressnumber | null
format float
Schema enforced

Done

Execution
done

Done

Result

Struct
result

Resulting Model Output

ResponseResponse8 fields
idstring | null
choicesArray<Choice>required
itemsChoicearray item
indexinteger:int32required
format int32
finish_reasonstringrequired
messageResponseMessagerequired
rolestringrequired
contentstring | null
refusalstring | null
annotationsarray | null
audioanyOf (2)
+2 more fields
logprobsanyOf (2)
variant 1LogProbsvariant
variant 2nullvariant
createdinteger | null
format uint64min 0
modelstring | null
service_tierstring | null
system_fingerprintstring | null
objectstring | null
usageUsagerequired
completion_tokensinteger:uint32required
format uint32min 0
prompt_tokensinteger:uint32required
format uint32min 0
total_tokensinteger:uint32required
format uint32min 0
costnumber | null
format double
prompt_tokens_detailsanyOf (2)
variant 1PromptTokenDetailsvariant
cached_tokensinteger | null
format uint32min 0
audio_tokensinteger | null
format uint32min 0
variant 2nullvariant
+2 more fields
Schema enforced

Stats

Struct
stats

Token usage, cost, and model statistics

LLMUsageStatsLLMUsageStats5 fields
usageUsagerequired
completion_tokensinteger:uint32required
format uint32min 0
prompt_tokensinteger:uint32required
format uint32min 0
total_tokensinteger:uint32required
format uint32min 0
costnumber | null
format double
prompt_tokens_detailsanyOf (2)
variant 1PromptTokenDetailsvariant
cached_tokensinteger | null
format uint32min 0
audio_tokensinteger | null
format uint32min 0
variant 2nullvariant
+2 more fields
modelstring | null
duration_msinteger | null
format uint64min 0
iterationsinteger | null
format uint32min 0
callsArray<ModelCallEntry>
itemsModelCallEntryarray item
modelstringrequired
usageUsagerequired
completion_tokensinteger:uint32required
format uint32min 0
prompt_tokensinteger:uint32required
format uint32min 0
total_tokensinteger:uint32required
format uint32min 0
costnumber | null
format double
prompt_tokens_detailsanyOf (2)
+2 more fields
duration_msinteger | null
format uint64min 0
Schema enforced

Node Info

Internal name
ai_generative_invoke
Category
AI/Generative
Version
4