Make manifest cache size configurable #9107

Job	Run time
integration-test-adls	1m 22s
cibw-dev-env-smoke-test	33s
integration-test	11m 1s
integration-test-gcs	49m 26s
lint-and-unit-test (3.10)	3m 30s
lint-and-unit-test (3.13)	3m 14s
lint-and-unit-test (3.12)	3m 20s
lint-and-unit-test (3.14)	2m 31s
integration-test-s3	1m 18s
lint-and-unit-test (3.11)	3m 6s
integration-coverage-report	30s
	1h 19m 51s

Provide feedback