Package net.thevpc.naru.ext.models.colibri

Class NaruColibriProvider

java.lang.Object

net.thevpc.naru.api.model.AbstractNaruModelProvider

net.thevpc.naru.ext.models.openapi.AbstractOpenAICompatProvider

net.thevpc.naru.ext.models.colibri.NaruColibriProvider

All Implemented Interfaces:

NaruModelProvider, net.thevpc.nuts.spi.NComponent

public class NaruColibriProvider
extends AbstractOpenAICompatProvider

Colibri provider — talks to a local Colibri OpenAI-compatible server (e.g. coli serve --host 127.0.0.1 --port 11435 --model-id glm-5.2-colibri).

Endpoint: POST {baseUrl}/v1/chat/completions (OpenAI-compatible wire).

Configuration:

 colibri.url=http://localhost:11435      (default: http://localhost:11435)
 colibri.chatPath=v1/chat/completions     (optional, default: v1/chat/completions)
 colibri.apiKey=...                       (optional; falls back to env COLI_API_KEY)
 colibri.models=glm-5.2-colibri,...       (optional static model list)
 colibri.contextLength=65536              (optional, default: 65536)
 colibri.probe=true                       (optional, default: true; when true the provider
                                           is hidden from '/model list' if the server is unreachable)
 

Models are addressed as colibri/<model>, e.g. colibri/glm-5.2-colibri.

Field Summary

Fields inherited from class net.thevpc.naru.ext.models.openapi.AbstractOpenAICompatProvider

protocols

Constructor Summary

Constructors

Constructor	Description
NaruColibriProvider()

Method Summary

Modifier and Type	Method	Description
protected String	baseUrl(NaruSession session)	Fallback base url when <name>.url config is not set.
protected String	chatPath()
protected NaruModelProtocol	createProtocol(NaruModelConfig model, NaruModelCapabilities capabilities, NaruSession session)
List<String>	findModelIds(NaruSession session)
boolean	isAvailable(NaruSession session)
protected String	modelsPath()
protected NaruModelCapabilities	resolveCapabilities(String modelName, NaruSession session)	Statically maps capabilities since cloud-hosted capabilities cannot be polled natively.

Methods inherited from class net.thevpc.naru.ext.models.openapi.AbstractOpenAICompatProvider

connectTimeout, fetchLiveModelIds, findModelIdsWithLiveFallback, getProtocol, isApiKeySet, isReachable, readTimeout

Methods inherited from class net.thevpc.naru.api.model.AbstractNaruModelProvider

apiKey, defaultEnvKey, getParam, getParamNames, getSecureParam, isEnabled, name, onParamChanged, setEnabled, setParam

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface net.thevpc.naru.api.model.NaruModelProvider

installModel, isSupportedInstallModel, isSupportedPsModel, isSupportedUninstallModel, isSupportedUnloadModel, psModel, uninstallModel, unloadModel

Constructor Details

NaruColibriProvider

public NaruColibriProvider()

Method Details

baseUrl

protected String baseUrl(NaruSession session)

Description copied from class: AbstractOpenAICompatProvider

Fallback base url when <name>.url config is not set.

Specified by:

baseUrl in class AbstractOpenAICompatProvider

chatPath

protected String chatPath()

Overrides:

chatPath in class AbstractOpenAICompatProvider

modelsPath

protected String modelsPath()

Overrides:

modelsPath in class AbstractOpenAICompatProvider

createProtocol

protected NaruModelProtocol createProtocol(NaruModelConfig model,
 NaruModelCapabilities capabilities,
 NaruSession session)

Overrides:

createProtocol in class AbstractOpenAICompatProvider

resolveCapabilities

protected NaruModelCapabilities resolveCapabilities(String modelName,
 NaruSession session)

Description copied from class: AbstractOpenAICompatProvider

Statically maps capabilities since cloud-hosted capabilities cannot be polled natively.

Specified by:

resolveCapabilities in class AbstractOpenAICompatProvider

isAvailable

public boolean isAvailable(NaruSession session)

findModelIds

public List<String> findModelIds(NaruSession session)

Specified by:

findModelIds in interface NaruModelProvider

Overrides:

findModelIds in class AbstractOpenAICompatProvider