Package net.thevpc.naru.ext.models.custom

Class NaruCustomProvider

java.lang.Object

net.thevpc.naru.api.model.AbstractNaruModelProvider

net.thevpc.naru.ext.models.openapi.AbstractOpenAICompatProvider

net.thevpc.naru.ext.models.custom.NaruCustomProvider

All Implemented Interfaces:

NaruModelProvider, net.thevpc.nuts.spi.NComponent

public class NaruCustomProvider
extends AbstractOpenAICompatProvider

Generic config-driven provider: lets users point NARU at any wire-compatible endpoint (OpenAI-compatible, Anthropic Messages, ...) with zero code.

Configuration (per named endpoint):

 custom.endpoints=<name1>,<name2>,...
 custom.endpoints.<name>.url=https://my-server
 custom.endpoints.<name>.type=openapi|anthropic   (optional, default: openapi)
 custom.endpoints.<name>.apiKey=sk-...
 custom.endpoints.<name>.models=model-a,model-b
 custom.endpoints.<name>.chatPath=v1/chat/completions   (optional)
 custom.endpoints.<name>.contextLength=32768             (optional)
 custom.endpoints.<name>.tools=true                      (optional)
 custom.endpoints.<name>.probe=true                      (optional, default: true)
 

Models are addressed as custom/<endpoint>/<model>.

By default each endpoint is probed (short-timeout GET on its url + TTL cache) before its models show up in listings; set probe=false to opt out.

Constructor Summary

Constructors

Constructor	Description
NaruCustomProvider()

Method Summary

Modifier and Type	Method	Description
protected String	baseUrl(NaruSession session)	Fallback base url when <name>.url config is not set.
List<String>	findModelIds(NaruSession session)
net.thevpc.nuts.util.NOptional<NaruModelProtocol>	getProtocol(NaruModelConfig model, NaruSession session)
boolean	isAvailable(NaruSession session)
protected NaruModelCapabilities	resolveCapabilities(String model, NaruSession session)	Statically maps capabilities since cloud-hosted capabilities cannot be polled natively.

Methods inherited from class net.thevpc.naru.ext.models.openapi.AbstractOpenAICompatProvider

chatPath, connectTimeout, createProtocol, fetchLiveModelIds, findModelIdsWithLiveFallback, isApiKeySet, isReachable, modelsPath, readTimeout

Methods inherited from class net.thevpc.naru.api.model.AbstractNaruModelProvider

apiKey, defaultEnvKey, getParam, getParamNames, getSecureParam, isEnabled, name, onParamChanged, setEnabled, setParam

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface net.thevpc.naru.api.model.NaruModelProvider

installModel, isSupportedInstallModel, isSupportedPsModel, isSupportedUninstallModel, isSupportedUnloadModel, psModel, uninstallModel, unloadModel

Constructor Details

NaruCustomProvider

public NaruCustomProvider()

Method Details

getProtocol

public net.thevpc.nuts.util.NOptional<NaruModelProtocol> getProtocol(NaruModelConfig model,
 NaruSession session)

Specified by:

getProtocol in interface NaruModelProvider

Overrides:

getProtocol in class AbstractOpenAICompatProvider

isAvailable

public boolean isAvailable(NaruSession session)

findModelIds

public List<String> findModelIds(NaruSession session)

Specified by:

findModelIds in interface NaruModelProvider

Overrides:

findModelIds in class AbstractOpenAICompatProvider

baseUrl

protected String baseUrl(NaruSession session)

Description copied from class: AbstractOpenAICompatProvider

Fallback base url when <name>.url config is not set.

Specified by:

baseUrl in class AbstractOpenAICompatProvider

resolveCapabilities

protected NaruModelCapabilities resolveCapabilities(String model,
 NaruSession session)

Description copied from class: AbstractOpenAICompatProvider

Statically maps capabilities since cloud-hosted capabilities cannot be polled natively.

Specified by:

resolveCapabilities in class AbstractOpenAICompatProvider