Installation¶

Bash

pip install apogee-ai-serving

Verify¶

Python

import apogee_ai_serving
print(apogee_ai_serving.__version__)

The base install has no required third-party dependency. Each extra unlocks one adapter.

Extra	Pulls in
`ollama`	ollama>=0.3
`vllm`	vllm>=0.6
`llamacpp`	llama-cpp-python>=0.2
`mlx`	mlx-lm>=0.18
`redis`	redis>=5.0
`embeddings`	apogee-ai-providers>=0.1
`all`	ollama>=0.3, vllm>=0.6, llama-cpp-python>=0.2, mlx-lm>=0.18, redis>=5.0, apogee-ai-providers>=0.1

One extraEverythingFrom the monorepo

Bash

pip install "apogee-ai-serving[ollama]"

Bash

pip install "apogee-ai-serving[all]"

Bash

pip install -e modules/ai_serving[dev]