API Reference — Overview

On this page

This section documents every public class, function, dataclass, and enum exported from the cache package (i.e. everything listed in cache.__all__ in cache/__init__.py, plus their directly-relevant supporting types). Names beginning with _ are private implementation details and are described only where they materially affect the behavior of a public API (e.g. CacheManager._run_sync, TenantManager._get_state).

Top-level exports (cache.__all__)

NameKindModulePage
CacheEntrydataclasscache.cache_entrycache_entry.md
CacheStrategyenumcache.cache_strategiesmulti_level_cache.md
MultiLevelCacheclasscache.multi_level_cachemulti_level_cache.md
CacheMetricsdataclasscache.cache_metricscache_metrics.md
CacheConfigdataclasscache.config_cacheconfig_cache.md
EmbeddingIndexclasscache.embedding_indexembedding_index.md
EmbeddingProviderenumcache.config_cacheconfig_cache.md
OllamaEmbeddingProviderclasscache.embedding_indexembedding_index.md
OpenAIEmbeddingProviderclasscache.embedding_indexembedding_index.md
HuggingFaceEmbeddingProviderclasscache.embedding_indexembedding_index.md
EmbeddingConfigdataclasscache.config_cacheconfig_cache.md
CostModelclasscache.cost_modelcost_model.md
CacheMetricsCollectorclasscache.metricsmetrics.md
RollingCounterclasscache.metricsmetrics.md
IntelligentCacheEntrydataclasscache.modelsmodels.md
TenantQuotaStatedataclasscache.modelsmodels.md
QueryNormalizerclasscache.normalizationnormalization.md
NormalizationConfigclasscache.normalizationnormalization.md
CachePolicyLearnerclasscache.policy_learnerpolicy_learner.md
SecurityGuardclasscache.securitysecurity.md
SecurityViolationexceptioncache.securitysecurity.md
SecurityConfigdataclasscache.config_cacheconfig_cache.md
CostConfigdataclasscache.config_cacheconfig_cache.md
TenantManagerclasscache.tenant_managertenant_manager.md
TenantConfigdataclasscache.config_cacheconfig_cache.md
TenantRegistrationdataclasscache.tenant_managertenant_manager.md
CacheManagerclasscache.cache_managercache_manager.md
CacheLookupResultdataclasscache.modelsmodels.md
CachedEmbedderclasscache.embedding_indexembedding_index.md
RedisStorageclasscache.storage.redisstorage/redis.md
SQLiteStorageclasscache.storage.sqlitestorage/sqlite.md
MemoryStorageclasscache.storage.storage_memorystorage/memory.md
build_storagefunctioncache.storage.factury_funstorage/factory.md
RLConfigdataclasscache.config_cacheconfig_cache.md
SemanticConfigdataclasscache.config_cacheconfig_cache.md
StorageBackendenumcache.config_cacheconfig_cache.md
FeedbackSignaldataclasscache.policy_learnerpolicy_learner.md
RoutingDecisionenumcache.config_cacheconfig_cache.md
RedisConfigdataclasscache.config_cacheconfig_cache.md
PerformanceConfigdataclasscache.config_cacheconfig_cache.md
DecisionEngineclasscache.cost_modelcost_model.md
OperationCostEstimatedataclasscache.cost_modelcost_model.md
QuotaExceededexceptioncache.tenant_managertenant_manager.md

[!NOTE] Names imported but not re-exported cache/__init__.py also imports SQLiteConfig from config_cache but does not include it in __all__. It remains importable as cache.SQLiteConfig (or from zerda.cache.config_cache import SQLiteConfig) — see config_cache.md.

Supporting types not in __all__

These are used by / returned from the public API above and are documented alongside their owning module, but are not themselves exported from the top-level package:

NameModuleNotes
BanditArmcache.modelsField of IntelligentCacheEntry.bandit_arm
CostRecordcache.modelsField of IntelligentCacheEntry.cost_record
BaseStoragecache.storage.base_storageAbstract base class; importable as cache.storage.BaseStorage
BaseEmbeddingProvidercache.embedding_indexAbstract base class for all embedding providers
MockEmbeddingProvidercache.embedding_indexDefault provider (EmbeddingProvider.MOCK)
EvictionCandidatecache.policy_learnerReturn element type of CachePolicyLearner.eviction_ranking
RoutingResultcache.cost_modelReturn type of DecisionEngine.decide
LatencyHistogramcache.metricsUsed internally by CacheMetricsCollector
EvictionPolicycache.config_cacheType of EvictionConfig.policy

Module responsibility summary

ModuleType of componentResponsibility
cache_managerOrchestratorTies every other subsystem together into get/put/feedback
multi_level_cacheStandalone cacheGeneric 3-tier memory/memory/disk cache
modelsData modelsEntry, lookup result, bandit arm, cost record, tenant quota state
cache_entryData modelSimple entry type for MultiLevelCache
config_cacheConfigurationAll dataclasses/enums controlling behavior
normalizationPipeline stageCanonicalizes raw queries before hashing/embedding
embedding_indexPipeline stageText → vector, vector similarity search
cost_modelPipeline stageUSD cost estimation and cache-vs-LLM routing
policy_learnerPipeline stageBayesian bandit ranking, eviction scoring, decay
tenant_managerPipeline stageMulti-tenant quotas and isolation
securityPipeline stageInjection detection, PII scrubbing, integrity checks
metricsObservabilityCentral metrics collector for the pipeline
cache_metricsObservabilitySimple hit-rate counters for MultiLevelCache
storagePersistencePluggable backends behind a common BaseStorage contract

Related pages