Is your feature request related to a problem? Please describe.
We recently merged Evaluation PR and deployed it to staging #405
There are few PR Review comments that are more like enhancements which can be worked on once the initial version of feature is out
- Show token usage for evaluation run
- Explore automating setting up evaluator step
- Save evaluation run id so can be used as hyperlink
- See how we can use newer models and new config
Is your feature request related to a problem? Please describe.
We recently merged Evaluation PR and deployed it to staging #405
There are few PR Review comments that are more like enhancements which can be worked on once the initial version of feature is out