Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
32 changes: 32 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -75,6 +75,38 @@ uv run vf-eval wordle -m gpt-5-nano

For advanced evaluation configurations with the `prime` [CLI](https://github.com/PrimeIntellect-ai/prime-cli), see [here](https://docs.primeintellect.ai/tutorials-environments/evaluating)

## Prompt Optimization with GEPA

Automatically improve your environment's prompts using GEPA (Genetic-Pareto):

```bash
# Install GEPA extras
uv add 'verifiers[gepa]'

# Optimize system prompt
vf-gepa wordle --budget medium

# Optimize system prompt + tool descriptions
vf-gepa wiki-search --budget heavy --components system_prompt tool_descriptions
```

GEPA analyzes your rubric's feedback and iteratively refines prompts. Works best when reward functions return rich textual feedback. See the [GEPA documentation](docs/source/gepa.md) for details.

After a run completes, apply the saved components to an environment instance:

```python
import json
import verifiers as vf

with open("gepa_results/wordle/<run_id>/wordle_optimized.json") as f:
optimized = json.load(f)

env = vf.load_environment("wordle")
env.system_prompt = optimized["system_prompt"]
if "tool_0_description" in optimized and hasattr(env, "oai_tools"):
env.oai_tools[0]["function"]["description"] = optimized["tool_0_description"]
```

## RL Training

### `prime-rl`
Expand Down
Loading