Make manifest cache size configurable #9105

Job	Run time
cibw-dev-env-smoke-test	30s
integration-test-s3	1m 13s
integration-test-adls	1m 32s
integration-test	11m 16s
lint-and-unit-test (3.13)	3m 18s
lint-and-unit-test (3.11)	4m 5s
integration-test-gcs	13m 12s
lint-and-unit-test (3.14)	2m 52s
lint-and-unit-test (3.10)	3m 22s
lint-and-unit-test (3.12)	3m 14s
integration-coverage-report	1s
	44m 35s

Provide feedback