[BUG] [RAG][v0.12.6]Getting a "Key error" for IC-OP CLONE on one of the runs in GSM8K.

[chethan-rfai]

Bug Description

Getting a "Key error" for IC-OP CLONE on one of the runs in GSM8K.
Parent Pipeline: 2 -> Clone Pipeline : 9 : Change -> "reasoning_effort": "medium" to "high"

To Reproduce

Steps to reproduce the behavior:

1. Go to and Run GSM8K notebook
2. Click on IC-OP panel to CLONE by changing "reasoning_effort": "medium" to "high"
3. Verify the clones

Expected Behavior

CLONE run expected to work for all params mentioned in the parent run

Screenshots

Environment

• OS: Ubuntu
• Python version: 3.12
• RapidFire AI version: 0.12.6
• Browser (if applicable): NA

Additional Context

Models and Configs supported for that models needs a review

Error Logs

rapidfire_KeyError_on_CLONE_GSM8K.log

[anay-rfai]

List of changes made:

1. reasoning_effort removed from non-reasoning models like 4o
2. max_completion_tokens increased when high reasoning effort is used to accommodate think tokens
3. downsampled dataset
4. changed retrieval config and metrics computation for scifact