LLM Node
The LLM Node connects to language model providers and generates text completions based on input prompts.
Supported Providers
OpenAI
GPT-4o, o1
Anthropic
Claude Opus 4.7, Sonnet, Haiku
Local Models
Ollama, vLLM, TGI
Azure OpenAI
Azure-hosted OpenAI models
AWS Bedrock
Titan, Claude and 30+ model profiles
Hugging Face
Any compatible model from HF Hub
Configuration Parameters
| Parameter | Description | Default |
|---|---|---|
| model | Select the model to use | - |
| api_key | Your provider API key (stored encrypted) | - |
| temperature | 0.0 (deterministic) to 2.0 (creative) | 0.7 |
| max_tokens | Maximum output length | 1024 |
| system_message | System prompt for role/behavior instructions | - |
| streaming | Real-time token streaming | false |
Inputs & Outputs
Input
Text (prompt string) or Message (structured chat message)
Output
Text (generated completion) or Message (structured response with metadata)
The LLM Node can be chained with Prompt Template nodes for dynamic prompt construction.