Skip to content

Fix: Frontier cs 2.0 blackbox evaluator (#117)#118

Merged
joyemang33 merged 1 commit into
mainfrom
harbor-progress-curve
May 27, 2026
Merged

Fix: Frontier cs 2.0 blackbox evaluator (#117)#118
joyemang33 merged 1 commit into
mainfrom
harbor-progress-curve

Conversation

@joyemang33
Copy link
Copy Markdown
Contributor

  • feat: isolate Frontier-CS 2.0 evaluator

  • feat: add Erdos demo task

  • fix: regenerate default Harbor tasks before trials

Summary

Please read CONTRIBUTING.md before submitting.

Type of Change

  • New research problem
  • New algorithmic problem
  • New Frontier-CS 2.0 problem
  • Bug fix
  • Documentation update
  • Other:

Testing

Checklist

  • Code follows the project structure and conventions
  • Self-review completed
  • Documentation updated (if applicable)

CI Validation (for new problems)

When adding new problems, CI will automatically validate that your reference solution achieves score > 0.

  • Algorithmic problems: Include reference.cpp in your problem directory
  • Research problems: Include reference.py (or reference.cpp if language: cpp in config.yaml)
  • 2.0 problems: Include reference.py unless the problem config declares another language

* feat: isolate Frontier-CS 2.0 evaluator

* feat: add Erdos demo task

* fix: regenerate default Harbor tasks before trials

## Summary
<!-- Brief description of changes -->

> Please read [CONTRIBUTING.md](../CONTRIBUTING.md) before submitting.

## Type of Change
- [ ] New research problem
- [ ] New algorithmic problem
- [ ] New Frontier-CS 2.0 problem
- [ ] Bug fix
- [ ] Documentation update
- [ ] Other:

## Testing
<!-- How were these changes tested? -->

## Checklist
- [ ] Code follows the project structure and conventions
- [ ] Self-review completed
- [ ] Documentation updated (if applicable)

## CI Validation (for new problems)
> When adding new problems, CI will automatically validate that your reference solution achieves score > 0.
> - Algorithmic problems: Include `reference.cpp` in your problem directory
> - Research problems: Include `reference.py` (or `reference.cpp` if `language: cpp` in config.yaml)
> - 2.0 problems: Include `reference.py` unless the problem config declares another language
@joyemang33 joyemang33 merged commit ec95e95 into main May 27, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant