Stream Message Node

S

AI/GitHub/Copilot/Chat

Sends a message to Copilot and streams the response. Supports history input and matches Model Invoke interface.

copilot_send_streamingllmLong running

Inputs4

Outputs6

Security exposure7/10

Packagellm

Ratings

Scores range from 0 to 10. Higher values mean more impact, exposure, or operational weight.

SecurityAttack surface and exposure impact.

7/10High

PrivacyPotential sensitivity of processed data.

5/10Medium

PerformanceRuntime or resource pressure.

6/10Medium

GovernancePolicy, audit, or compliance impact.

7/10High

ReliabilityOperational stability considerations.

7/10High

CostExternal or compute cost impact.

6/10Medium

Input Pins

4

Input

Execution

exec_in

Trigger Pin

Session

Struct

session

Copilot session

SchemaCopilotSessionHandleCopilotSessionHandleCopilotSessionHandle3 fields

cache_keystringrequired

Unique cache key for this session instance

session_idstringrequired

Session ID from Copilot

client_keystringrequired

Reference to parent client

Schema enforced

Prompt

String

prompt

Message to send

History

Struct

history

Optional chat history for context (same format as Model Invoke)

SchemaHistoryHistoryHistory19 fields

modelstringrequired

messagesArray<HistoryMessage>required

itemsHistoryMessagearray item

roleRolerequired

enum "system", "user", "assistant", "function"...

contentMessageContentrequired

variant 1stringvariant

variant 2Array<Content>variant

namestring | null

tool_callsarray | null

itemsToolCallarray item

tool_call_idstring | null

+1 more fields

presetstring | null

streamboolean | null

stream_optionsanyOf (2)

variant 1StreamOptionsvariant

include_usagebooleanrequired

variant 2nullvariant

max_completion_tokensinteger | null

format uint32min 0

top_pnumber | null

format float

temperaturenumber | null

format float

thinkinganyOf (2)

variant 1HistoryThinkingvariant

enum "off", "low", "mid", "high"

variant 2nullvariant

seedinteger | null

format uint32min 0

presence_penaltynumber | null

format float

frequency_penaltynumber | null

format float

userstring | null

stoparray | null

itemsstringarray item

response_formatanyOf (2)

variant 1ResponseFormatvariant

variant 1stringvariant

variant 2nullvariant

ninteger | null

format uint32min 0

toolsarray | null

itemsToolarray item

typeToolTyperequired

enum "function"

functionHistoryFunctionrequired

namestringrequired

descriptionstring | null

parametersHistoryFunctionParametersrequired

tool_choiceanyOf (2)

variant 1ToolChoicevariant

variant 1nullvariant

variant 2nullvariant

variant 3nullvariant

variant 4objectvariant

typeToolTyperequired

enum "function"

functionHistoryFunctionrequired

variant 2nullvariant

+1 more fields

Output Pins

6

On Stream

Execution

on_stream

Fires for each streaming chunk (matches Model Invoke)

Done

Execution

done

Fires when streaming is complete (matches Model Invoke)

Chunk

Struct

chunk

Current streaming chunk (matches Model Invoke ResponseChunk format)

SchemaResponseChunkResponseChunkResponseChunk8 fields

idstringrequired

choicesArray<ResponseChunkChoice>required

itemsResponseChunkChoicearray item

indexinteger:int32required

format int32

deltaanyOf (2)

variant 1Deltavariant

variant 2nullvariant

finish_reasonstring | null

logprobsanyOf (2)

variant 1LogProbsvariant

variant 2nullvariant

createdinteger | null

format uint64min 0

modelstring | null

service_tierstring | null

system_fingerprintstring | null

usageanyOf (2)

variant 1Usagevariant

completion_tokensinteger:uint32required

format uint32min 0

prompt_tokensinteger:uint32required

format uint32min 0

total_tokensinteger:uint32required

format uint32min 0

costnumber | null

format double

prompt_tokens_detailsanyOf (2)

variant 1PromptTokenDetailsvariant

variant 2nullvariant

+2 more fields

variant 2nullvariant

x_prefill_progressnumber | null

format float

Schema enforced

Result

Struct

result

Complete response (matches Model Invoke Response format)

SchemaResponseResponseResponse8 fields

idstring | null

choicesArray<Choice>required

itemsChoicearray item

indexinteger:int32required

format int32

finish_reasonstringrequired

messageResponseMessagerequired

rolestringrequired

contentstring | null

content_partsArray<Content>

Ordered structured content returned by Rig when the assistant response contains media. Text-only responses continue to use `content` alone for OpenAI compatibility.

refusalstring | null

annotationsarray | null

+3 more fields

logprobsanyOf (2)

variant 1LogProbsvariant

variant 2nullvariant

createdinteger | null

format uint64min 0

modelstring | null

service_tierstring | null

system_fingerprintstring | null

objectstring | null

usageUsagerequired

completion_tokensinteger:uint32required

format uint32min 0

prompt_tokensinteger:uint32required

format uint32min 0

total_tokensinteger:uint32required

format uint32min 0

costnumber | null

format double

prompt_tokens_detailsanyOf (2)

variant 1PromptTokenDetailsvariant

cached_tokensinteger | null

format uint32min 0

audio_tokensinteger | null

format uint32min 0

variant 2nullvariant

+2 more fields

Schema enforced

Full Response

String

full_response

Complete accumulated response text

Stats

Struct

stats

Token usage, cost, and model statistics

SchemaLLMUsageStatsLLMUsageStatsLLMUsageStats5 fields

usageUsagerequired

completion_tokensinteger:uint32required

format uint32min 0

prompt_tokensinteger:uint32required

format uint32min 0

total_tokensinteger:uint32required

format uint32min 0

costnumber | null

format double

prompt_tokens_detailsanyOf (2)

variant 1PromptTokenDetailsvariant

cached_tokensinteger | null

format uint32min 0

audio_tokensinteger | null

format uint32min 0

variant 2nullvariant

+2 more fields

modelstring | null

duration_msinteger | null

format uint64min 0

iterationsinteger | null

format uint32min 0

callsArray<ModelCallEntry>

itemsModelCallEntryarray item

modelstringrequired

usageUsagerequired

completion_tokensinteger:uint32required

format uint32min 0

prompt_tokensinteger:uint32required

format uint32min 0

total_tokensinteger:uint32required

format uint32min 0

costnumber | null

format double

prompt_tokens_detailsanyOf (2)

+2 more fields

duration_msinteger | null

format uint64min 0

Schema enforced

Node Info

Internal name

copilot_send_streaming

Category

AI/GitHub/Copilot/Chat

Version

2