fix(openai): Avoid consuming iterables passed to the Embeddings API #1388
alexander-alderman-webbtest-integrations-agents.yml
on: pull_request
Matrix: Agents
All Agents tests passed
2s
Annotations
17 warnings
|
Agents (3.11, ubuntu-22.04)
❌ Patch coverage check failed: 0.00% < target 80%
|
|
Agents (3.14t, ubuntu-22.04)
❌ Patch coverage check failed: 0.00% < target 80%
|
|
Agents (3.14t, ubuntu-22.04)
Failed to upload coverage artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Agents (3.14t, ubuntu-22.04)
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Iterator created at test collection time will be exhausted before test runs:
tests/integrations/openai/test_openai.py#L1144
The test uses `iter([...])` directly in `pytest.param()`, which creates the iterator at module load/collection time, not at test execution time. In pytest, parameters are evaluated once during collection. If pytest introspects the parameters (e.g., for --collect-only, verbose output, or test reporting), or if tests are re-run, the iterator may be partially or fully consumed before the actual test executes. This makes the test unreliable and may cause false positives/negatives.
|
|
Agents (3.10, ubuntu-22.04)
❌ Patch coverage check failed: 0.00% < target 80%
|
|
Agents (3.10, ubuntu-22.04)
Failed to upload coverage artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Agents (3.10, ubuntu-22.04)
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Agents (3.12, ubuntu-22.04)
❌ Patch coverage check failed: 0.00% < target 80%
|
|
Agents (3.12, ubuntu-22.04)
Failed to upload coverage artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Agents (3.12, ubuntu-22.04)
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Agents (3.14, ubuntu-22.04)
❌ Patch coverage check failed: 0.00% < target 80%
|
|
Agents (3.14, ubuntu-22.04)
Failed to upload coverage artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Agents (3.14, ubuntu-22.04)
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Agents (3.13, ubuntu-22.04)
❌ Patch coverage check failed: 0.00% < target 80%
|
|
Agents (3.13, ubuntu-22.04)
Failed to upload coverage artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Agents (3.13, ubuntu-22.04)
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
codecov-coverage-results-webb-stop-consuming-embeddings-test-agents
|
104 KB |
sha256:7e7469466d5b500eb85eb670230223fe15a31eab2fef674cd50e9687bb9b5b08
|
|
|
codecov-test-results-webb-stop-consuming-embeddings-test-agents
|
236 Bytes |
sha256:10ca47b166eb5d0ddfabd35c955b611e9d5e09ca665fe18d8d7b9eda75a86ee5
|
|