Fix fetch failed due to unsupported expect header

[rinatkhaziev]

This pull request adds a new utility to strip unsupported HTTP headers (specifically the Expect header) from requests made to S3, and introduces a test to verify this behavior in the uploadImportFileToS3 function. This ensures better compatibility with the undici HTTP client and S3 presigned URLs.

Testing and Bug Fixes:

• Added a test for uploadImportFileToS3 in __tests__/lib/client-file-uploader.js to verify that unsupported Expect headers are stripped from presigned S3 uploads.
• Imported uploadImportFileToS3 into the test file to enable testing of the new behavior.

HTTP Header Handling Improvements:

• Added the stripUndiciUnsupportedHeaders utility to remove unsupported headers (like Expect) from HTTP requests before sending them with undici.
• Updated fetchWithRetry to use stripUndiciUnsupportedHeaders on all outgoing requests, improving compatibility and preventing errors with S3 and the undici client.
• Included the Headers class from undici to support header manipulation.

Pull request checklist

• Update SETUP.md with any new environmental variables.
• Update the documentation.
• Manually test the relevant changes.
• Follow the pull request checklist
• Add/update automated tests as needed.

New release checklist

• Automated tests pass.
• The Preparing for release checklist is completed.

Steps to Test

Outline the steps to test and verify the PR here.

Example:

1. Check out PR.
2. Run npm run build
3. Run ./dist/bin/vip-cookies.js nom
4. Verify cookies are delicious.

[github-actions]

Dependency Review

✅ No vulnerabilities or license issues or OpenSSF Scorecard issues found.

Scanned Files

None

[rinatkhaziev]

superseded by #2905

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud