Home

    ---
    title: apogee-ai-eval
    description: Offline + online evaluation harness with G-Eval, faithfulness, bias and judge-LLM scorers.
    ---

    # apogee-ai-eval

    > Offline + online evaluation harness with G-Eval, faithfulness, bias and judge-LLM scorers.

    ## What is in this package

    | Capability | What you get |

| --- | --- | | Scorers | G-Eval, faithfulness, bias, judge-LLM | | Harness | Evaluator runs a list of scorers over a dataset | | Online sampling | Hooks to score a percentage of live traffic |

    ## Install

    ```bash
    pip install apogee-ai-eval
    ```

    ## Where it fits

    This package is part of the [Apogee Framework](/framework/) ecosystem. It can be used:

    - **Standalone** — install and use directly via `pip` (or `npm` for `@apogee/ai-ui-react`).
    - **As a plugin** — generated projects detect it and register matching CLI subcommands automatically.

    See the [framework's modules overview](/framework/modules/overview/) for how all 28 packages fit together.

    ## Read next

    - [Installation](getting-started/installation.md)
    - [Quickstart](getting-started/quickstart.md)
    - [Reference](reference/index.md)