Skip to content

InvokeLLMSimpleNode

Purpose of the Node

The InvokeLLMSimpleNode node is designed to invoke an LLM (Large Language Model) with a given system prompt and user prompt. It handles the streaming output and triggers connected nodes accordingly.

Pins

Pin NamePin DescriptionPin TypeValue Type
StartTrigger pin to start the node executionExecutionN/A
ModelModel to be invokedStructBit
System PromptSystem prompt for the LLMStringN/A
PromptUser prompt for the LLMStringN/A
On StreamTrigger pin activated on streaming outputExecutionN/A
TokenStreaming token from the LLMStringN/A
DoneTrigger pin activated once the execution is doneExecutionN/A
ResultResulting model outputStringN/A