model port takes a genai.model, which
holds the model, its credentials and its sampling settings.
Ports
The component has a flow input and two flow outputs, the routessuccess and failure. A failed call takes the
failure route.
The sampling settings, including
stop_sequences, are the provider’s, not the chat’s: they sit on the genai.model
(Settings), and a run can replace them for one run
(Choosing a Model per Run). The models the provider offers are
listed in The catalog, and the credential each
vendor needs in
Vendors and credentials.
The conversation sent
The messages go to the model in this order:system, with its role set to system; then every message of history;
then current. A message whose role is not system, user or assistant is sent as user. With no message at all,
the node posts the error No input messages provided and fails.
The chat is text only. A message holding any content block other than text fails the node with
unsupported_content_block: <type>, so a file or a JSON block is refused rather than dropped.
The answer format
response_format asks the model for text, for JSON, or for JSON that follows response_schema. Each vendor takes it in
its own way:
Anthropic answers text whatever the format, and with
json or json_schema the call posts the warning
"response_format" is specified but is not currently supported. With json_schema and an empty response_schema, the
node fails with schema_required_in_json_schema_mode for OpenAI and Gemini.
The output
Theoutput is one message, with the role assistant unless output_role says otherwise, holding text blocks:
- OpenAI: the text of the first choice.
- Anthropic: the text blocks of the answer. Thinking and every other block are left out.
- Gemini: the text parts of the first candidate. Parts marked as thoughts are left out.
refusal: <category>, or refusal alone when the vendor gives no category; a Gemini prompt the vendor blocks fails
with refusal: <reason>; and a Gemini reply with no candidate and no reason fails with no_candidates. Other refusals
arrive as an empty or partial answer on success: an OpenAI answer with no text or stopped by its content filter, and a
Gemini answer stopped for SAFETY.
Events
A call posts oneprocessor.output event. Its attributes.model names the model that ran, as {"id", "chosen_by"},
and its data holds:
request: the arguments sent to the vendor’s API;response: the vendor’s answer as JSON;usage:input_tokensandoutput_tokens.
processor.warning for each setting it left out, for a model a run named that the
catalog does not list, and for a format the vendor ignored. A failed call posts a processor.error
(When the call fails). How to read which
model a run used is in Choosing a Model per Run.
