Skip to content

Stream Message Node

AI/GitHub/Copilot/Chat

Stream Message

Sends a message to Copilot and streams the response. Supports history input and matches Model Invoke interface.

copilot_send_streamingllmLong running
Inputs4
Outputs6
Security exposure3/10
Packagellm

Ratings

Scores range from 0 to 10. Higher values mean more impact, exposure, or operational weight.

SecurityAttack surface and exposure impact.
3/10High
PrivacyPotential sensitivity of processed data.
5/10Medium
PerformanceRuntime or resource pressure.
4/10Medium
GovernancePolicy, audit, or compliance impact.
3/10High
ReliabilityOperational stability considerations.
3/10High
CostExternal or compute cost impact.
4/10Medium

Input Pins

4

Input

Execution
exec_in

Trigger Pin

Session

Struct
session

Copilot session

CopilotSessionHandleCopilotSessionHandle3 fields
cache_keystringrequired

Unique cache key for this session instance

session_idstringrequired

Session ID from Copilot

client_keystringrequired

Reference to parent client

Schema enforced

Prompt

String
prompt

Message to send

History

Struct
history

Optional chat history for context (same format as Model Invoke)

HistoryHistory19 fields
modelstringrequired
messagesArray<HistoryMessage>required
itemsHistoryMessagearray item
roleRolerequired
enum "system", "user", "assistant", "function"...
contentMessageContentrequired
variant 1stringvariant
variant 2Array<Content>variant
namestring | null
tool_callsarray | null
itemsToolCallarray item
tool_call_idstring | null
+1 more fields
presetstring | null
streamboolean | null
stream_optionsanyOf (2)
variant 1StreamOptionsvariant
include_usagebooleanrequired
variant 2nullvariant
max_completion_tokensinteger | null
format uint32min 0
top_pnumber | null
format float
temperaturenumber | null
format float
thinkinganyOf (2)
variant 1HistoryThinkingvariant
enum "off", "low", "mid", "high"
variant 2nullvariant
seedinteger | null
format uint32min 0
presence_penaltynumber | null
format float
frequency_penaltynumber | null
format float
userstring | null
stoparray | null
itemsstringarray item
response_formatanyOf (2)
variant 1ResponseFormatvariant
variant 1stringvariant
variant 2nullvariant
ninteger | null
format uint32min 0
toolsarray | null
itemsToolarray item
typeToolTyperequired
enum "function"
functionHistoryFunctionrequired
namestringrequired
descriptionstring | null
parametersHistoryFunctionParametersrequired
tool_choiceanyOf (2)
variant 1ToolChoicevariant
variant 1nullvariant
variant 2nullvariant
variant 3nullvariant
variant 4objectvariant
typeToolTyperequired
enum "function"
functionHistoryFunctionrequired
variant 2nullvariant
+1 more fields

Output Pins

6

On Stream

Execution
on_stream

Fires for each streaming chunk (matches Model Invoke)

Done

Execution
done

Fires when streaming is complete (matches Model Invoke)

Chunk

Struct
chunk

Current streaming chunk (matches Model Invoke ResponseChunk format)

ResponseChunkResponseChunk8 fields
idstringrequired
choicesArray<ResponseChunkChoice>required
itemsResponseChunkChoicearray item
indexinteger:int32required
format int32
deltaanyOf (2)
variant 1Deltavariant
variant 2nullvariant
finish_reasonstring | null
logprobsanyOf (2)
variant 1LogProbsvariant
variant 2nullvariant
createdinteger | null
format uint64min 0
modelstring | null
service_tierstring | null
system_fingerprintstring | null
usageanyOf (2)
variant 1Usagevariant
completion_tokensinteger:uint32required
format uint32min 0
prompt_tokensinteger:uint32required
format uint32min 0
total_tokensinteger:uint32required
format uint32min 0
costnumber | null
format double
prompt_tokens_detailsanyOf (2)
variant 1PromptTokenDetailsvariant
variant 2nullvariant
+2 more fields
variant 2nullvariant
x_prefill_progressnumber | null
format float
Schema enforced

Result

Struct
result

Complete response (matches Model Invoke Response format)

ResponseResponse8 fields
idstring | null
choicesArray<Choice>required
itemsChoicearray item
indexinteger:int32required
format int32
finish_reasonstringrequired
messageResponseMessagerequired
rolestringrequired
contentstring | null
refusalstring | null
annotationsarray | null
audioanyOf (2)
+2 more fields
logprobsanyOf (2)
variant 1LogProbsvariant
variant 2nullvariant
createdinteger | null
format uint64min 0
modelstring | null
service_tierstring | null
system_fingerprintstring | null
objectstring | null
usageUsagerequired
completion_tokensinteger:uint32required
format uint32min 0
prompt_tokensinteger:uint32required
format uint32min 0
total_tokensinteger:uint32required
format uint32min 0
costnumber | null
format double
prompt_tokens_detailsanyOf (2)
variant 1PromptTokenDetailsvariant
cached_tokensinteger | null
format uint32min 0
audio_tokensinteger | null
format uint32min 0
variant 2nullvariant
+2 more fields
Schema enforced

Full Response

String
full_response

Complete accumulated response text

Stats

Struct
stats

Token usage, cost, and model statistics

LLMUsageStatsLLMUsageStats5 fields
usageUsagerequired
completion_tokensinteger:uint32required
format uint32min 0
prompt_tokensinteger:uint32required
format uint32min 0
total_tokensinteger:uint32required
format uint32min 0
costnumber | null
format double
prompt_tokens_detailsanyOf (2)
variant 1PromptTokenDetailsvariant
cached_tokensinteger | null
format uint32min 0
audio_tokensinteger | null
format uint32min 0
variant 2nullvariant
+2 more fields
modelstring | null
duration_msinteger | null
format uint64min 0
iterationsinteger | null
format uint32min 0
callsArray<ModelCallEntry>
itemsModelCallEntryarray item
modelstringrequired
usageUsagerequired
completion_tokensinteger:uint32required
format uint32min 0
prompt_tokensinteger:uint32required
format uint32min 0
total_tokensinteger:uint32required
format uint32min 0
costnumber | null
format double
prompt_tokens_detailsanyOf (2)
+2 more fields
duration_msinteger | null
format uint64min 0
Schema enforced

Node Info

Internal name
copilot_send_streaming
Category
AI/GitHub/Copilot/Chat
Version
2