All Classes and Interfaces
Class
Description
Base class for OpenAI-compatible cloud providers (Groq, Cerebras, OpenRouter, GitHub Models, ...).
Cerebras provider — free-tier, high-speed inference for open models
through Cerebras' OpenAI-compatible API.
Generic OpenAI-compatible provider driven entirely by configuration.
Gemini provider — talks to Google AI Studio through the OpenAI-compatible router.
GitHub Models provider — free inference for a curated catalog of models
using any GitHub Personal Access Token (PAT).
Groq provider — free-tier, ultra-fast inference for open models
through Groq's OpenAI-compatible API.
Ollama provider — talks to a local (or remote) Ollama server via REST.
{
"choices" : [ {
"finish_reason" : "tool_calls",
"index" : 0,
"message" : {
"role" : "assistant",
"tool_calls" : [ {
"function" : {
"arguments" : "{\"path\":\"core/nut-api\",\"include\":\"*.java\",\"recursive\":true}",
"name" : "folder_find"
},
"id" : "function-call-11464485064754065774",
"type" : "function"
} ]
}
} ],
"created" : 1779459950,
"id" : "bWcQau20G9n2nsEPs9z20Qw",
"model" : "gemini-2.5-flash",
"object" : "chat.completion",
"usage" : {
"completion_tokens" : 28,
"prompt_tokens" : 4500,
"total_tokens" : 4592
}
}
OpenRouter provider — one API key gives access to hundreds of models,
including a rotating set of
:free variants.