Package net.thevpc.naru.ext.models.cache

package net.thevpc.naru.ext.models.cache
  • Classes
    Class
    Description
    NaruCacheBaseline
    The last cache identity this session established, persisted between turns.
    NaruCacheKeyChain
    Computes the cache identity of a segmented context as a hash chain rather than as a set of independent per-segment hashes.
    NaruCachePlan
    The caching decision for one request: which segments are a continuation of the previously cached prefix, and where a client-controlled cache marker should go.
    NaruModelCacheExtension
    Per-session prompt-cache bookkeeping.
    NaruModelCaching
    Runtime entry point for prompt caching: given a request and a provider's declared support, decide what prefix (if any) can be reused, and remember what was actually sent.