Flexible manifest input

[ppinchuk]

Allow user to specify multiple collection manifest fp's, possible containing wildcards. This allows arbitrary jurisdiction extraction runs on batched collections.

[codecov-commenter]

Codecov Report

❌ Patch coverage is 83.33333% with 1 line in your changes missing coverage. Please review.
✅ Project coverage is 63.54%. Comparing base (8b2418f) to head (2c5f1d5).

Files with missing lines	Patch %	Lines
compass/pipeline/coordinator.py	66.66%	0 Missing and 1 partial ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #516      +/-   ##
==========================================
- Coverage   63.55%   63.54%   -0.02%     
==========================================
  Files          78       78              
  Lines        7365     7367       +2     
  Branches      741      741              
==========================================
  Hits         4681     4681              
- Misses       2532     2533       +1     
- Partials      152      153       +1     

Flag	Coverage Δ
unittests	63.54% <83.33%> (-0.02%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[Copilot]

Pull request overview

This PR extends extraction-mode collection manifest handling so users can pass either a single manifest path or multiple manifest paths (optionally with glob patterns), enabling batched extraction runs across arbitrary jurisdiction sets.

Changes:

• Added load_collection_manifest_jurisdictions() to load and merge jurisdiction entries from one or more manifest files and to resolve persisted document paths when loading manifests.
• Updated the extraction coordinator workflow to use the new jurisdictions loader instead of loading a single manifest dict.
• Added unit tests covering manifest input variants (string vs Path, relative vs absolute, globbed vs explicit, single vs list) and shard-path resolution.

Reviewed changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated 2 comments.

File	Description
tests/python/unit/pipeline/test_pipeline_collection_persistence.py	Adds unit tests for multi-manifest inputs, wildcard support, and path resolution behavior.
compass/pipeline/data_classes.py	Updates request docstrings to describe list/glob-capable collection_manifest_fp.
compass/pipeline/coordinator.py	Switches extraction-mode manifest loading to the new multi-manifest jurisdictions loader.
compass/pipeline/collection/persistence.py	Implements multi-manifest jurisdictions loading and enables path resolution when loading manifests.