Skip to content

Enable evals CI: add ANTHROPIC_API_KEY secret #9

@siracusa5

Description

@siracusa5

The evals workflow skips silently when ANTHROPIC_API_KEY is not set (see #ci: skip evals gracefully). Once harness-kit is further along, enable it:

Steps

  1. Add the secret:

    gh secret set ANTHROPIC_API_KEY --repo harnessprotocol/harness-kit
    
  2. Verify the next release run picks it up and the compatibility page updates automatically (evals/results/latest.json + website/docs/evals/compatibility.md).

Context

Evals run on every release publish and commit updated results back to the repo. The workflow is in .github/workflows/evals.yml. Nothing else needs to change — just the secret.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions